-- Logs begin at Wed 2022-05-25 16:24:54 UTC, end at Wed 2022-05-25 17:26:39 UTC. -- May 25 16:53:55.417363 dv-cinder-843309-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 16:53:55.424546 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 16:53:55 2022] *** May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: nodename: dv-cinder-843309-1-iscsi May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: machine: x86_64 May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: clock source: unix May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: pcre jit disabled May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: detected number of CPU cores: 4 May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: current working directory: / May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: detected binary path: /usr/bin/uwsgi-core May 25 16:53:55.427604 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: your processes number limit is 47680 May 25 16:53:55.428181 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: your memory page size is 4096 bytes May 25 16:53:55.428181 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: detected max file descriptor number: 2048 May 25 16:53:55.428181 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: lock engine: pthread robust mutexes May 25 16:53:55.428181 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: thunder lock: enabled May 25 16:53:55.428181 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 16:53:55.428181 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 16:53:55.473185 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: Python main interpreter initialized at 0x5580965809c0 May 25 16:53:55.473185 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: python threads support enabled May 25 16:53:55.473185 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: your server socket listen backlog is limited to 100 connections May 25 16:53:55.473185 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: your mercy for graceful operations on workers is 90 seconds May 25 16:53:55.473550 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: mapped 403077 bytes (393 KB) for 2 cores May 25 16:53:55.473625 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: *** Operational MODE: preforking *** May 25 16:53:55.473865 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: *** uWSGI is running in multiple interpreter mode *** May 25 16:53:55.473865 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: spawned uWSGI master process (pid: 80151) May 25 16:53:55.474070 dv-cinder-843309-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 16:53:55.474904 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: spawned uWSGI worker 1 (pid: 80162, cores: 1) May 25 16:53:55.474993 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: spawned uWSGI worker 2 (pid: 80163, cores: 1) May 25 16:53:55.476712 dv-cinder-843309-1-iscsi devstack@keystone.service[80151]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 16:54:01.125768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:54:01.125768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: from cryptography.utils import int_from_bytes May 25 16:54:01.126642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:54:01.126642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: from cryptography.utils import int_from_bytes May 25 16:54:01.169922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:54:01.169922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: from cryptography.utils import int_from_bytes May 25 16:54:01.170444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:54:01.170444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: from cryptography.utils import int_from_bytes May 25 16:54:01.176314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:54:01.176508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:54:01.176725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] command line args: [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:54:01.176994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:54:01.177170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ================================================================================ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:54:01.177424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] admin_token = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.177664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config_dir = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.177848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.178026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] config_source = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.178205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] debug = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.178399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_config_append = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.179959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.180115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_dir = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.180288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.180519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.180787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.181033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.181276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.181454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.181630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.181871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.182113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.182343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.182571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.182799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.183029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.183270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.183510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.183780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.184260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.184441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] publish_errors = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.184669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.184917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.185092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.185334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.185565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.185798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] standard_threads = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.186028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.186266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.186440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.186619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_journal = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.186791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_json = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.186964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_stderr = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.187394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] use_syslog = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.187622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.187875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.188111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.188367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.188603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.188934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.189335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.189578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.189810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.190058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.190304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.190553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.190785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.191028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.191263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.191506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.191750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.191983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.192236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.192486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.192754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.192991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.193241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.193499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.193747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.193991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.194220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.194447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.194675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.194906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.195148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.195391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.195617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.195845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.196085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.196329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.196563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.196836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.197068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.197299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.197529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.197757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.197983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.198209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.198435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.198667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.198911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.199140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.199372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.199598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.199831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.200062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.200305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.200535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.200791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.201025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.201256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.201489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.201719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.201945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.202188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.202420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.202652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.202879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.203130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.203362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.203589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.203821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.204056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.204317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.204622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.204931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.205174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.205410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.205642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.205876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.206121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.206357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.206591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.206836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.207070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.207305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.207538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.207769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.208002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.208260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.208497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.208763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.209001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.209240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.209475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.209710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.209944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.210172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.210399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.210627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.210860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.211086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.211323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.211555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.211797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.212029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.212280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.212535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.212798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.213030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.external = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.213257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.213549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.213956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.214192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.password = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.214419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] auth.token = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.214668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.214899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.215142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.215369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.215611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.215855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.216082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.216317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.216559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.217924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.217924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.217924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.217924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.217924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.218228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.218431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.218667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.218916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.219194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.219435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.219693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.219931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.220968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.221280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:54:01.221391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:54:01.221468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.221588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] command line args: [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:54:01.221758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.222012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.222099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:54:01.222264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.222344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ================================================================================ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:54:01.222498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.222746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.222825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] admin_token = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.222983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.223237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.223321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] config_dir = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.223473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.223627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.223732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.223969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.224054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] config_source = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.224216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.224301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] debug = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.224539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.224743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.225034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.225188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.225329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.225479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.225563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.225745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.225825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.225967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.226056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.226175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_config_append = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.226251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.226376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.226452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.226568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_dir = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.226643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.226722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.226901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.227039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.227144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.227220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.227381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.227593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.227672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.227799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.227887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.227986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.228066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.228235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.228321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.228483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.228567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.228738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.228823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.228978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.229069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.229213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.229295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.229450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.229535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.229700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.229786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.229936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.230021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.230166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.230245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.230401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.230630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.230717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.230864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.230945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] publish_errors = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.231100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.231186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.231335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.231413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.231514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.231592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.231761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.231918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.231997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.232074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.232225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] standard_threads = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.232314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.232461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.232548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.232726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.232808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.232911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.232992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.233092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] use_journal = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.233180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.233255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] use_json = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.233414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.233500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] use_stderr = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.233600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] use_syslog = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.233679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.233834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:54:01.233923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.234879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.235842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.236438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.236605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.236787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.236871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.237854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.238817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.239991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.240950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.241908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.242993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.243928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.244975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.245924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.246887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.247957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.248919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.249878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.250986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.251866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.252969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.253970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.254940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.255880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.256999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257683 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.257998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.258948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.external = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.259891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.password = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.token = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.260877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261518 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.261997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.263969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.264940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.265880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.266037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.266116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.266271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.266430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.266507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:54:01.266580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.266812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.267134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.267402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.267638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.267887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.268127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.268385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.268626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.268907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.269147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.269397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.269637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.269886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.270141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.270381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.270620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.270869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.271103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.271343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.271595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.271848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.272084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.272316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.272550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.272822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.273072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.273321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.273578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.273826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.274098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.274338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.274579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.274811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.275050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.275282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.275520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.275760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.276001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.276250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.276483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.276757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.277007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.277244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.277491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.277738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.277970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.278207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.278437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.278676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.278914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.279159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.279395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.279633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.279882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.280135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.280366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.280598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.280868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.281130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.281369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.281605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.281841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.282074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.282314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.282573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.283400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.283678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.284177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.284416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.284645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.284945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.285184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.285420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.285772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.286023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.286274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.286523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.286774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.287022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.287251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.287502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.287744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.287985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.288243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.288523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.288838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.289133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.289409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.289707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.289984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.290269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.290548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.290827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.291106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.291394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.291675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.291931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.292151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.292395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.292648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.292927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.293167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.293421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.293675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.293915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.294162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.294403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.294644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.294882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] role.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.295130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] role.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.295364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.295614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.295863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.296114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.296393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.296641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.296928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.297200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.297466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.297725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.297975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.298244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.299066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.299337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.299755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.300052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.300345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.300606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.300887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.300968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.301143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.301223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.301373 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.301457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.301627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.301881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.302122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.302355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.302590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.302823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.303075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.303331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.303581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.303820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.304057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.304289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.304526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.304786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.305036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.305275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.305532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.305780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.306017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.306260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.306506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.306752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.306991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.307231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.307468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.307714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.307962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.308193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.308437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.308770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.309034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.309280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.309529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.309765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.309953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.310117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.310248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.310485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.310721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.311279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.311537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.311777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.312276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.312513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.312789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.313027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.313281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.313514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.313757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.314021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:54:01.314187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:54:01.338522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.338749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.339176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.339414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.339643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.350539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.370495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.370728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.392669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.408952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.444385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.444610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.447554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.447790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.511989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.511989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.512239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.512482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.512600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.512824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.513062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.513226 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.513310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.513474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.513803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.514059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.537070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.537369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.537542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.537695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.537855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.537998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.538985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.551129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.551390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.564878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.565961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.566039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.566169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.566270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:54:01.585567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.585770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:54:01.585863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.586062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:54:01.586168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.586295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:54:01.586406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.586563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.586645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:54:01.586821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.586913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.587073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.587155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.587323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.587403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.587601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.598682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.598925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.599187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.599459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.600430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.600739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.601014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.601296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.607506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.609410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.611333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.611610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.611976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.612262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.612544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.612828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.613209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.613290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.613483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.613564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.613753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.613836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.614028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.614108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.614296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.614375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.614720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.614997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.615277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.615552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.615830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.616104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.641318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.643409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.643504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.643641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.645100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.645383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.648902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.649179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.649456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.650667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.650950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.651234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.656694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.656979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.658569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.658855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.661502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.661902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.662184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.662463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.662737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.663010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.663282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.663362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.663547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.663716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.664003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.664289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.664572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.664883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.665160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.665436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.682576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.682853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.685153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.685439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.687789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.690622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.691614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.691907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.694295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.694593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.697025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.699593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.700563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.703336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.704329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.705253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.705553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.705834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.706117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.706393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.707666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.707969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.708268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.708554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.708893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.709193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.725310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.725587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.725850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.726112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.728165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.728450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.728742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.729012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.734023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.736233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.736745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.737564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.739266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.739553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.739651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.739829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.740105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.740382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.740655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.742609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.742889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.743180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.743469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.743751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.754148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.754428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.754706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.754984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.755262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.755542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.755818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.757382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.757663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.757946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.758237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.758520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.758798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.759083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.774240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.777512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.777679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.780814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.780957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.782418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.784192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.784475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.784784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.786161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.788641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.790309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.790598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.790891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.792886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.794480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.797725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.798018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.798867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.798867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.799344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.800956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.804194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.804492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.804815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.805109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.808299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.808583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.808985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.814695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.814979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.815365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.817347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.817628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.817906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.818182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.818451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.818726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.819010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.819276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.819559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.819826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.820094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.820351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.820619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.820907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.823331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:54:01.823612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.823900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.824180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.824460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.824759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.825038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.825319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.825590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.825881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.826156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.826420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.826687 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.826955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:54:01.860186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580965809c0 pid: 80163 (default app) May 25 16:54:01.863549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9202-a7ba-48d4-9ffb-226e8647d00b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:01.863837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9202-a7ba-48d4-9ffb-226e8647d00b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:01.864110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9202-a7ba-48d4-9ffb-226e8647d00b None None] PATH_INFO: `/v3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:01.866441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580965809c0 pid: 80162 (default app) May 25 16:54:01.868355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 791 bytes} [Wed May 25 16:54:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:09.857888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:09.858452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:09.858452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:09.863369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:09.868860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:09.869289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:09.869409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:09.937430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: INFO dbcounter [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] Registered counter for database keystone May 25 16:54:09.959174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG oslo_db.sqlalchemy.engines [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:54:09.965317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writer thread running {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:54:10.141861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG passlib.handlers.bcrypt [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80163) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 16:54:10.142463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG passlib.handlers.bcrypt [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80163) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 16:54:10.198924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:10.200461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:10.323224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 16:54:10.468615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:10.539066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: INFO dbcounter [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] Registered counter for database keystone May 25 16:54:10.558708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG oslo_db.sqlalchemy.engines [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:54:10.565567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writer thread running {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:54:10.687937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa882d5-a4b8-42fb-9186-553d2203f79a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:10.692657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:10.693348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:10.693631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:10.693906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:10.702059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:10.756076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 16:54:10.756352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d8206-f9ed-44f4-8d5d-4a786c68e8c3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:10.766082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 2/4] 10.222.0.31 () {58 vars in 1324 bytes} [Wed May 25 16:54:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:54:10.773469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:10.788387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38625edf-b934-46d3-9e00-3ad801997a5e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:10.792874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:10.794228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:10.794521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:10.794806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] PATH_INFO: `/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:10.796334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] RBAC: Authorizing `identity:get_project(project_id=a1e51ce5f84b498ea59e7bf6bab45356)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:10.955687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 16:54:10.956304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf489100-cee1-4621-b92f-28881e9d3369 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:10.960868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 3/5] 10.222.0.31 () {56 vars in 1207 bytes} [Wed May 25 16:54:10 2022] GET /identity/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:13.133285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995efd-a3a7-4fac-833d-25a796beb269 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:13.133794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995efd-a3a7-4fac-833d-25a796beb269 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:13.133894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995efd-a3a7-4fac-833d-25a796beb269 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:13.137935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 3/6] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:13.144124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:13.144497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:13.144692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:13.163533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:13.165141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:13.172868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 16:54:13.195488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995efd-a3a7-4fac-833d-25a796beb269 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:13.207996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995efd-a3a7-4fac-833d-25a796beb269 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:13.212175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74634-268d-4c13-bdc6-c8b54cc8bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:13.212842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74634-268d-4c13-bdc6-c8b54cc8bd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:13.213133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74634-268d-4c13-bdc6-c8b54cc8bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:13.213413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74634-268d-4c13-bdc6-c8b54cc8bd81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:13.221590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74634-268d-4c13-bdc6-c8b54cc8bd81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:13.223376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74634-268d-4c13-bdc6-c8b54cc8bd81 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:13.232056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 4/8] 10.222.0.31 () {58 vars in 1324 bytes} [Wed May 25 16:54:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:54:13.237749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:13.246636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764600-0fa0-47ba-b944-48158ddfe05f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:13.250916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ac45c-a6e5-4650-b41a-d86ce1fef521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:13.252371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac45c-a6e5-4650-b41a-d86ce1fef521 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:13.252647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac45c-a6e5-4650-b41a-d86ce1fef521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:13.252944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac45c-a6e5-4650-b41a-d86ce1fef521 admin admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:13.254324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ac45c-a6e5-4650-b41a-d86ce1fef521 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:13.256155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ac45c-a6e5-4650-b41a-d86ce1fef521 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:13.257701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 5/9] 10.222.0.31 () {56 vars in 1198 bytes} [Wed May 25 16:54:13 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:15.503905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ecb2d-8ea9-4386-98bc-2e5c732a86b8 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.504822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ecb2d-8ea9-4386-98bc-2e5c732a86b8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.505102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ecb2d-8ea9-4386-98bc-2e5c732a86b8 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.506445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:15.511538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.511988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.512176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.529382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:15.530564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:15.592240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869898e3-1cd6-4659-846b-989136d22633 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.592533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869898e3-1cd6-4659-846b-989136d22633 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.592846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869898e3-1cd6-4659-846b-989136d22633 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.594177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 6/11] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:15.599811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.600102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.600384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.610625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 6/12] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:15.633911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.641115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG passlib.handlers.bcrypt [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80162) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 16:54:15.641548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG passlib.handlers.bcrypt [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80162) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 16:54:15.657934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:15.690934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:15.692543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:15.739731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ccac-70a3-4ca4-af48-1d961ebb7723 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.773694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.774430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.774716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.775002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.786355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:15.790898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 7/13] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:15.797614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:15.799748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:15.800858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 7/14] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:15.805183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.813514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.893256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:15.910762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec72b-cc61-4ac4-b1dc-32706779a42c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.911523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d22bd-9c83-4a1a-9d68-3c944e64b97b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.913184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:15.946251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.946909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.947195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.947480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.949391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.950313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.950603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.950888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.951873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:15.952188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.953662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.965356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 8/15] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:15.970979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.014614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.016114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.071344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4f35-8aa5-45b6-b77c-a67382b7c1f4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.096015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:16.106319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.107188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.107466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.107735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.109310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.111349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.112982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 9/16] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:16.115764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 8/17] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:54:16.118592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.120992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.153233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:16.219398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6fa8-abe6-4dac-94ed-819e9919411d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.219575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821605ae-1e83-4e32-9e79-995b16bf29e2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.253614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.253807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.254405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.254524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.254691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.254815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.254967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.255094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.256153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.257657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.259447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 10/18] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:16.265064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.265181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.266619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:54:16.286071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:16.286936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:16.287735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:54:16.287735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:54:16.287735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:54:16.287735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:16.287735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 9/19] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:16.292990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.327736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:16.366131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654b10-fa02-4b20-bd23-62bf907387f2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.367657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:16.396316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf972db-d3cf-4adf-9041-6ac5b5bc92de None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.401955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.402611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.402897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.403172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.404007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.domain.id=default, user.id=cc4dc5eccddf4937ae7c342c241f1972) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:16.404322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.405810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7951b7-e97e-4958-a752-bb49e93e47e8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.415373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 11/20] 10.222.0.31 () {56 vars in 1322 bytes} [Wed May 25 16:54:16 2022] GET /identity/v3/role_assignments?user.id=cc4dc5eccddf4937ae7c342c241f1972&scope.domain.id=default&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:16.430869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.431563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.431852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.432132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.432970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:16.433303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.434772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae463d0-ce71-4510-962c-4200b013b9b3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.455322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 10/21] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:18.926466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a46d4-d3e1-465d-be97-1ed1db00c0ec None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:18.927545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a46d4-d3e1-465d-be97-1ed1db00c0ec None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:18.928025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a46d4-d3e1-465d-be97-1ed1db00c0ec None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:18.929984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 12/22] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:18.935093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:18.935941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:18.936446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:18.971566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:18.973112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:19.068824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 11/23] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:19.104553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a46d4-d3e1-465d-be97-1ed1db00c0ec None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:19.249815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a46d4-d3e1-465d-be97-1ed1db00c0ec None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:19.298780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd63dc-2486-4efc-bfbd-6f4ad319c267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:19.299579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd63dc-2486-4efc-bfbd-6f4ad319c267 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.299863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd63dc-2486-4efc-bfbd-6f4ad319c267 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.300140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd63dc-2486-4efc-bfbd-6f4ad319c267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.318152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd63dc-2486-4efc-bfbd-6f4ad319c267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-89cd63dc-2486-4efc-bfbd-6f4ad319c267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:19.330333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:19.331228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:19.331978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:19.337101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 13/24] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:19.338383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:19.389177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:19.389728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd73f-bc1a-4e27-94c3-e6c8a4e75dd3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.390021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd73f-bc1a-4e27-94c3-e6c8a4e75dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.390677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd73f-bc1a-4e27-94c3-e6c8a4e75dd3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.393255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 14/25] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:19.416336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff1bd-06cf-4002-b5fb-54bf544bd8e8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.417006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff1bd-06cf-4002-b5fb-54bf544bd8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.417485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff1bd-06cf-4002-b5fb-54bf544bd8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.538406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee359d1-9c77-43b7-909e-78c33cedbf0e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:19.597733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:19.598688 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.599101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.599503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.600388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:19.600860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:19.602406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:19.621655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 12/26] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:19.629684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:19.635266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-118ff1bd-06cf-4002-b5fb-54bf544bd8e8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:19.636578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-118ff1bd-06cf-4002-b5fb-54bf544bd8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:19.673125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:19.719872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 15/27] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:19.722396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0b3c-b3de-447d-b5fe-a9756d2adf39 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.722893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0b3c-b3de-447d-b5fe-a9756d2adf39 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.723367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0b3c-b3de-447d-b5fe-a9756d2adf39 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.724859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 16/28] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:19.726558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55034b5b-dda5-465a-af44-25cd8a701fd9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.727021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55034b5b-dda5-465a-af44-25cd8a701fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.727465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55034b5b-dda5-465a-af44-25cd8a701fd9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.729423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 17/29] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:19.732209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a262258-c5b5-4ff0-bb71-dc71269ddfff None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.735861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a262258-c5b5-4ff0-bb71-dc71269ddfff None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.736427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a262258-c5b5-4ff0-bb71-dc71269ddfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.758916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0a262258-c5b5-4ff0-bb71-dc71269ddfff None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:19.760376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a262258-c5b5-4ff0-bb71-dc71269ddfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:19.774706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:19.795570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba588b-d3ba-481d-abf4-ff56017e451a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:19.839824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:19.840705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.841157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.841435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.842770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 18/30] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:19.843091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:19.844446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.845394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:19.846079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.846079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.848248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 13/31] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:19 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:19.849257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:19.866066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:19.867553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:19.944035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 19/32] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:19.945721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:19.969066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:19.974981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224abeb-8549-47a0-b4f8-e93f4106c5ac None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.022242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.023294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.023770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.024237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.025215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.026800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:20.057551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b3dea-46f4-45e6-8863-decb2fbf92dc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.099349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.100345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.100789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.101167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.102498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.104264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:20.106385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 20/33] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:20.107345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:20.167475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 14/34] 10.222.0.31 () {60 vars in 1131 bytes} [Wed May 25 16:54:19 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:20.168966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:20.205500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:20.214040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:20.223539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608324-49ee-4508-9842-884beffa3670 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.268781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.269477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.269765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.270044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.270865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.272483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:20.406824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949132c7-c32c-4dc2-a53f-f35f58e8fad3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.449082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.450255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.450742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.451237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.460330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 21/35] 10.222.0.31 () {60 vars in 1131 bytes} [Wed May 25 16:54:20 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:20.465342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:20.466959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.469266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:54:20.496527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:20.497445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:20.498243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:54:20.498243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:54:20.498243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:54:20.498243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:20.501223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 15/36] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:20.507644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:20.604942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:20.655485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7d460-9754-4b4d-8119-5a6ce77a22c4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.666412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4a8e-e59d-4cc6-9165-f45b97361dcb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.714548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad6e2-3af7-496d-bf56-add9d676da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.715468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad6e2-3af7-496d-bf56-add9d676da31 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.715760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad6e2-3af7-496d-bf56-add9d676da31 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.716050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad6e2-3af7-496d-bf56-add9d676da31 None admin] PATH_INFO: `/v3/domains/default/users/cc4dc5eccddf4937ae7c342c241f1972/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.720554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad6e2-3af7-496d-bf56-add9d676da31 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cc4dc5eccddf4937ae7c342c241f1972, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.722265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad6e2-3af7-496d-bf56-add9d676da31 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:20.732165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.732165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.732165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.732534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.733185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:20.733475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.738318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:20.744731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 22/37] 10.222.0.31 () {58 vars in 1361 bytes} [Wed May 25 16:54:20 2022] PUT /identity/v3/domains/default/users/cc4dc5eccddf4937ae7c342c241f1972/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:20.745948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0430-e13e-46cd-9537-9eddfb0f7b51 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.746252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0430-e13e-46cd-9537-9eddfb0f7b51 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.746538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0430-e13e-46cd-9537-9eddfb0f7b51 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.748014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 23/38] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:20.758282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650c7c-a105-4fd0-8366-c39355ff0bc6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.758573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650c7c-a105-4fd0-8366-c39355ff0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.758851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650c7c-a105-4fd0-8366-c39355ff0bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.768094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 16/39] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:20.781003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:20.786355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:20.804543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bb650c7c-a105-4fd0-8366-c39355ff0bc6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:20.806167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb650c7c-a105-4fd0-8366-c39355ff0bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:20.911429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 24/40] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:20.921481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ca250-c4c6-4df9-a8e3-778ad3694c11 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.921481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ca250-c4c6-4df9-a8e3-778ad3694c11 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.921481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ca250-c4c6-4df9-a8e3-778ad3694c11 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.921481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 25/41] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:20.922268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.922567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.922902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.937823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53419452-b403-4ba5-a951-468f72dea7a6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:20.947369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:20.948574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:20.973287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:20.984054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:20.984996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:20.985101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:20.985341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:20.986720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:20.988391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:21.017371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 17/42] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:54:20 2022] POST /identity/v3/projects => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:21.018677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:21.031488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 26/43] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:21.070418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:21.139102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68a2d3-f03e-4ea4-b5fe-2120e5109d52 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:21.145964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:21.179405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:21.180138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:21.180427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:21.180738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:21.182064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:21.183570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:21.190576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 18/44] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:21.191590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:21.192626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eb143-e3b6-4ac4-9b66-0295457d5420 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:21.233861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e8c5a-9a35-4989-b298-03528633c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:21.234970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8c5a-9a35-4989-b298-03528633c5fd None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:21.235623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8c5a-9a35-4989-b298-03528633c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:21.236209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8c5a-9a35-4989-b298-03528633c5fd None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:21.237331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e8c5a-9a35-4989-b298-03528633c5fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:21.239006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e8c5a-9a35-4989-b298-03528633c5fd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:21.247257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:21.256573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 27/45] 10.222.0.31 () {60 vars in 1131 bytes} [Wed May 25 16:54:21 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:21.327855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5d38-ff7f-4d9c-ae39-6a84ba31a3a2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:21.370861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ff4c-9768-4c72-b890-02b69c35c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:21.371563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ff4c-9768-4c72-b890-02b69c35c715 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:21.371854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ff4c-9768-4c72-b890-02b69c35c715 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:21.372140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ff4c-9768-4c72-b890-02b69c35c715 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:21.372921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ff4c-9768-4c72-b890-02b69c35c715 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:21.374456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ff4c-9768-4c72-b890-02b69c35c715 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:21.403789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 19/46] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:54:21 2022] POST /identity/v3/projects => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:22.995601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f1e5-ad77-46fd-921c-fa84cb320161 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:22.996105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f1e5-ad77-46fd-921c-fa84cb320161 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:22.996105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f1e5-ad77-46fd-921c-fa84cb320161 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:22.997453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 28/47] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:23.003219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.003628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.003796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.020554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:23.022119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:23.087899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 20/48] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:23.112012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81f1e5-ad77-46fd-921c-fa84cb320161 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.215376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81f1e5-ad77-46fd-921c-fa84cb320161 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:23.239015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:23.250278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:23.251611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.251973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.252340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.262415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:23.270149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:23.270968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:23.271959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 29/49] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:23.277320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.305034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:23.377447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2af72-dad0-4763-a693-7a9fcaba49da None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:23.410611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:23.411286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.411575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.411858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.412645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:23.412988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:23.414383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:23.422357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 21/50] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:23.428436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.541130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15c14-c824-4c86-a98a-24e6e219908a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:23.574557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efa1a2-1bb8-4d9f-ba64-74a50d2a9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:23.575429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa1a2-1bb8-4d9f-ba64-74a50d2a9c66 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.575716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa1a2-1bb8-4d9f-ba64-74a50d2a9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.575994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efa1a2-1bb8-4d9f-ba64-74a50d2a9c66 None admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.577221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efa1a2-1bb8-4d9f-ba64-74a50d2a9c66 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:23.578670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efa1a2-1bb8-4d9f-ba64-74a50d2a9c66 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:23.580344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 30/51] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:23 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:23.585764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.653816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8febe-3d19-46cf-ae53-44e754e2d498 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.654107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8febe-3d19-46cf-ae53-44e754e2d498 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.654396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8febe-3d19-46cf-ae53-44e754e2d498 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.655744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 31/52] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:23.661201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.661486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.661764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.677287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:23.682809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:23.684029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:23.688795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5fb27-ab89-4f04-9b27-ed98696a1dbe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:23.727111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:23.727941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.728243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.728520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.729750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:23.731217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:23.732642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:23.732855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 22/53] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:23.739371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.753543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 32/54] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:23.776245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.839873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4c29-9a18-4c99-bddc-238ebd8c06ab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:23.874290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:23.874954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.875243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.875520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.876418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.domain.id=default, user.id=cc4dc5eccddf4937ae7c342c241f1972) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:23.876832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:23.878209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:23.881548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8fc9-7aa8-4827-a0d3-7629f45da725 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:23.885550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 23/55] 10.222.0.31 () {56 vars in 1322 bytes} [Wed May 25 16:54:23 2022] GET /identity/v3/role_assignments?user.id=cc4dc5eccddf4937ae7c342c241f1972&scope.domain.id=default&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:23.918147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61496c-1798-43c5-b98b-12f3c73b0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:23.918975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61496c-1798-43c5-b98b-12f3c73b0a3c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:23.919265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61496c-1798-43c5-b98b-12f3c73b0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:23.919542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61496c-1798-43c5-b98b-12f3c73b0a3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:23.920834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61496c-1798-43c5-b98b-12f3c73b0a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:23.922361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61496c-1798-43c5-b98b-12f3c73b0a3c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:23.925562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 33/56] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:23.931219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:23.961270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:24.044521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924f82d-baa8-4d3f-9468-5d92f8dca0e0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:24.082573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fa36-5700-43f9-a4d6-ebd276859097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:24.083243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fa36-5700-43f9-a4d6-ebd276859097 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:24.083531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fa36-5700-43f9-a4d6-ebd276859097 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:24.083811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fa36-5700-43f9-a4d6-ebd276859097 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:24.084538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fa36-5700-43f9-a4d6-ebd276859097 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:24.086070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fa36-5700-43f9-a4d6-ebd276859097 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:24.113142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 24/57] 10.222.0.31 () {60 vars in 1140 bytes} [Wed May 25 16:54:23 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:26.308319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fda9c1-196c-4739-b536-7e1ec339c8ea None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:26.308895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fda9c1-196c-4739-b536-7e1ec339c8ea None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:26.308895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fda9c1-196c-4739-b536-7e1ec339c8ea None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:26.310269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 34/58] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:26.315721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:26.316136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:26.316292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:26.333296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:26.334500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:26.400050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 25/59] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:26.425437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fda9c1-196c-4739-b536-7e1ec339c8ea None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:26.475419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:26.525138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fda9c1-196c-4739-b536-7e1ec339c8ea None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:26.557894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f5b88-c0f7-4f79-aa63-7c0a4b4c9560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:26.558736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f5b88-c0f7-4f79-aa63-7c0a4b4c9560 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:26.558969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f5b88-c0f7-4f79-aa63-7c0a4b4c9560 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:26.559248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f5b88-c0f7-4f79-aa63-7c0a4b4c9560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:26.560415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f5b88-c0f7-4f79-aa63-7c0a4b4c9560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:26.561900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f5b88-c0f7-4f79-aa63-7c0a4b4c9560 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:26.563881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 35/60] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:26.569570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:26.572728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:26.667503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e583e7-96e6-4150-a1b3-9fe60e297fe0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:26.703519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005acb0a-3204-46e4-9acb-78a0385d0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:26.704806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005acb0a-3204-46e4-9acb-78a0385d0592 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:26.705095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005acb0a-3204-46e4-9acb-78a0385d0592 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:26.705375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005acb0a-3204-46e4-9acb-78a0385d0592 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:26.706091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005acb0a-3204-46e4-9acb-78a0385d0592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:26.707561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005acb0a-3204-46e4-9acb-78a0385d0592 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:26.731425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 26/61] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:26 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:30.056639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47c99f-183f-4b56-9598-4756adfdfe93 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.057480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47c99f-183f-4b56-9598-4756adfdfe93 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.057920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47c99f-183f-4b56-9598-4756adfdfe93 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.059414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 36/62] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:30.065918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.066686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.067108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.093688 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:30.095185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:30.155006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6147-3f85-4c5a-8a68-89df41903a55 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.155300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6147-3f85-4c5a-8a68-89df41903a55 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.155571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6147-3f85-4c5a-8a68-89df41903a55 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.157140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 37/63] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:30.162688 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.163140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.163660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.177216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:30.188083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 27/64] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:30.197715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:30.198912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:30.218426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.330156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 38/65] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:30.353466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.418309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228c5d2-4e49-4766-97dc-5738a13404a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:30.455259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:30.489434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07560c1-ec7d-481b-b333-ccc206c5836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:30.490261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07560c1-ec7d-481b-b333-ccc206c5836b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.490550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07560c1-ec7d-481b-b333-ccc206c5836b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.490828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07560c1-ec7d-481b-b333-ccc206c5836b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.503926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07560c1-ec7d-481b-b333-ccc206c5836b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a07560c1-ec7d-481b-b333-ccc206c5836b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:30.512382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:30.513319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:30.514083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:30.517216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 28/66] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:30.518906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5235c92-7384-47a4-aa69-7ac307ff0b89 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.519440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5235c92-7384-47a4-aa69-7ac307ff0b89 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.519938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5235c92-7384-47a4-aa69-7ac307ff0b89 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.521611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 29/67] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:30.527610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.528255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.528801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.540855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee15044-8b0f-40bf-8a22-db911c111df1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:30.548104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:30.549916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:30.587074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:30.587821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.588116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.588398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.602014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:30.606822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:30.612772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:30.613691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:30.614449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:30.615363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 39/68] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:30.617068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.636389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 30/69] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:30.637757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.737845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815217-f3d7-4091-8eaf-0fd812663703 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:30.751579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:30.767147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1006095-dde2-493e-9064-6911ed881d31 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:30.781535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:30.782284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.782571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.782847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.783768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:30.784081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:30.785510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:30.794513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 40/70] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:30.799904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.812670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:30.813462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.813757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.814044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.814819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:30.815134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:30.816550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525188b6-6aa9-451c-bc4d-e29a32869d49 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:30.826274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 31/71] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:30.827692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20eefc-f14a-43b6-9fef-d2a2c76ba0e3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.827990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20eefc-f14a-43b6-9fef-d2a2c76ba0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.828274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20eefc-f14a-43b6-9fef-d2a2c76ba0e3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.829752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 32/72] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:30.830472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20eefc-f14a-43b6-9fef-d2a2c76ba0e3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.875219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:30.905877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aad0f-3a17-4690-81d3-167a0b0cf6a8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:30.933441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20eefc-f14a-43b6-9fef-d2a2c76ba0e3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:30.940815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c2da-e198-47ec-a923-afcaaa5ae4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:30.941624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c2da-e198-47ec-a923-afcaaa5ae4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.941913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c2da-e198-47ec-a923-afcaaa5ae4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.942194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c2da-e198-47ec-a923-afcaaa5ae4f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.952364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85c2da-e198-47ec-a923-afcaaa5ae4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9e85c2da-e198-47ec-a923-afcaaa5ae4f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:30.960538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:30.961562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:30.962305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 41/73] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:30.962946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dee4e-5636-41b0-9c63-3e0f80a6c3e4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.963216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dee4e-5636-41b0-9c63-3e0f80a6c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.963508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dee4e-5636-41b0-9c63-3e0f80a6c3e4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.964746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 42/74] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:30.968822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dee4e-5636-41b0-9c63-3e0f80a6c3e4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:30.972614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa6dd-1254-4009-b141-374666757833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:30.973536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa6dd-1254-4009-b141-374666757833 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.973820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa6dd-1254-4009-b141-374666757833 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.974095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa6dd-1254-4009-b141-374666757833 None admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.975398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa6dd-1254-4009-b141-374666757833 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:30.976923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa6dd-1254-4009-b141-374666757833 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:30.978568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 33/75] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:30.979791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:30.980088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:30.980372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:30.997336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:30.997894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:30.998557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:31.067286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 34/76] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:31.068151 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.073196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dee4e-5636-41b0-9c63-3e0f80a6c3e4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.107088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629495-ae3c-441a-8407-1aebb3bc02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.107985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629495-ae3c-441a-8407-1aebb3bc02e1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.108273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629495-ae3c-441a-8407-1aebb3bc02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.108558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629495-ae3c-441a-8407-1aebb3bc02e1 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.122993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.124553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629495-ae3c-441a-8407-1aebb3bc02e1 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.126138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629495-ae3c-441a-8407-1aebb3bc02e1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.127979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 43/77] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:30 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:31.129216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.129511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.129792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.146021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:31.147231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:31.185809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2e0f-d2a9-4497-b438-bcc5f641121e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.213449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 44/78] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:31.217541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.220808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.221491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.221776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.222054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.222809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:31.223121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.224511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.236839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 35/79] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:31.237788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.239460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.319555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077656d5-d5f6-434b-b5c4-698ab6b1dbc2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.337072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015b3c-df38-4aec-b907-abd6df1a5d27 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.338565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.353758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.354420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.354711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.354993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.372345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.373173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.373453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.373736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.384422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:31.392174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:31.393052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:31.393777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 36/80] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:31.394389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.429245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.430720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.449240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.493697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e764df7-5420-4681-aa0b-b35bc43e9721 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.528962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.529621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.529911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.530192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.530897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 45/81] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:31.531738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.566051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.604928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.606404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.633179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bfee5-7be9-4caf-81f6-b3dc147e02c8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.650759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.668339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.669261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.669551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.669832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.671039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.672510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.674304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 46/82] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:31.679068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.711659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 37/83] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:31.712875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.773789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.777139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a2d18-3a5f-447d-9fcf-373fa6cb32c2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.811906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.812974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.813299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.813755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.814402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949451c5-3de3-4b25-9942-731e77802ace None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.814953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.816418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.818069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 47/84] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:31.818832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.851542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.852213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.852503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.852817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.853569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:31.853879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.855284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.863459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 38/85] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:31.864263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.877421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:31.922497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb3b6c-a184-4bc8-9b1c-cf4d8b894adb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.957333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:31.958210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:31.958500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:31.958784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:31.959997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:31.961491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:31.963395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 48/86] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:31.964165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:31.975222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd83685-91f5-49b1-a13c-5aef3d1c0d86 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:31.998888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.009840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.010497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.010787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.011065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.067961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fd1f-bea4-48d0-a6a4-efee3eba8e53 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.079817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.081371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.089841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.103133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.103990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.104276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.104550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.105755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.107214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.108932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 49/87] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:32.109671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.186504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 39/88] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:32.187571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.216752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.217168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1f916-4d8a-4fb5-b32a-ecf90b970b67 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.251585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.252265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.252554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.252868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.253589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.255043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.283160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 50/89] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:32 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:32.289839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.294669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5ccb-ac4d-46c5-844a-bf82faf3c5d7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.343252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.344187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.344576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.346098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.347521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.349058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.350805 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 40/90] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:32 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:32.351643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.358811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.423805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cb87c-d267-44c1-a3f2-103f77d15cf6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.454660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.463779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74dbf-ec92-41c8-81e6-0d6f8ce3b8a7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.464239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.464937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.465329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.465611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.466569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=cc4dc5eccddf4937ae7c342c241f1972) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:32.466884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.468427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.478907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 51/91] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:32 2022] GET /identity/v3/role_assignments?user.id=cc4dc5eccddf4937ae7c342c241f1972&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:32.478907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.525000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.525813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.526102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.526382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.527414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=af2521f6f90246608eabb4e52c5296fb) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:32.527743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.530397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.540102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 41/92] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:32 2022] GET /identity/v3/role_assignments?user.id=af2521f6f90246608eabb4e52c5296fb&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=81e2b7e27546405389402bc4b6987138 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:32.541731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.623669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722233cb-dfe8-443a-a960-0c21dcd71b38 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.638513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.678587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.679793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.680346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.681339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.682859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.684455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.686404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 52/93] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:32 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:32.693539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:32.717543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be29f46-f6e6-481c-98eb-0dde7eb378e2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.762085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.762789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.763085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.763420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.803597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:32.857260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b079c-fe2d-40e3-a722-56a0e5ddbb86 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:32.860166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.862921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.915776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:32.916448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:32.916761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:32.917043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:32.917885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] RBAC: Adding query filter params (role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=af2521f6f90246608eabb4e52c5296fb) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:32.918200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:32.919678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:32.926734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 53/94] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:32 2022] GET /identity/v3/role_assignments?user.id=af2521f6f90246608eabb4e52c5296fb&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=f9187cfd078c4241b44e62a19296c815 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:33.052104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 42/95] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:33.070670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:33.141156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:33.222071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7734f3-9d15-45f9-a939-5d140af088e7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:33.282020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc49b-b508-42ac-89a3-0ec3888bc29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:33.283294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc49b-b508-42ac-89a3-0ec3888bc29a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:33.283788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc49b-b508-42ac-89a3-0ec3888bc29a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:33.284267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc49b-b508-42ac-89a3-0ec3888bc29a None admin] PATH_INFO: `/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:33.285746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdc49b-b508-42ac-89a3-0ec3888bc29a None admin] RBAC: Authorizing `identity:get_project(project_id=0ffc95fbf75c4ca4b2786c263582bafc)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:33.287466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdc49b-b508-42ac-89a3-0ec3888bc29a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:33.289429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 54/96] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:33 2022] GET /identity/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:33.295394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:33.421068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:33.480555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45109d-5457-47d2-85aa-6d4d567e4a0d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:33.519028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:33.519342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:33.519837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:33.520324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:33.521665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=0ffc95fbf75c4ca4b2786c263582bafc, user.id=af2521f6f90246608eabb4e52c5296fb) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:33.522234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:33.524783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5711f-63d1-497e-b675-08f1c2698d1b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:33.532932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 43/97] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:33 2022] GET /identity/v3/role_assignments?user.id=af2521f6f90246608eabb4e52c5296fb&scope.project.id=0ffc95fbf75c4ca4b2786c263582bafc&role.id=81e2b7e27546405389402bc4b6987138 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:35.837075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7560ef-6c6d-46ef-b898-73c07d263ffc None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.837075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7560ef-6c6d-46ef-b898-73c07d263ffc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.837075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7560ef-6c6d-46ef-b898-73c07d263ffc None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:35.837075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 55/98] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:35.843971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.844984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.845507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:35.863725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:35.865297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:35.951572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1835f-460e-47ef-ad80-01417350d98b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.952174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1835f-460e-47ef-ad80-01417350d98b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.952719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1835f-460e-47ef-ad80-01417350d98b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:35.954859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 56/99] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:35.960355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d1257-7a70-4f9e-b10e-e499674c4f34 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.960930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d1257-7a70-4f9e-b10e-e499674c4f34 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.961431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d1257-7a70-4f9e-b10e-e499674c4f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:35.961627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 44/100] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:35.979980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-dd5d1257-7a70-4f9e-b10e-e499674c4f34 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:35.981521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-dd5d1257-7a70-4f9e-b10e-e499674c4f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:35.997421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.090219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:36.124283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 57/101] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:36.126080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b79fd-b943-4e72-8b18-ea577d676aa7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.126633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b79fd-b943-4e72-8b18-ea577d676aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.127061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b79fd-b943-4e72-8b18-ea577d676aa7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.128917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 58/102] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:36.135209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863fad-f27e-4ac9-a1b3-4d2fed0f84c9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.135667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863fad-f27e-4ac9-a1b3-4d2fed0f84c9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.136119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863fad-f27e-4ac9-a1b3-4d2fed0f84c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.174419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-83863fad-f27e-4ac9-a1b3-4d2fed0f84c9 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:36.176466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-83863fad-f27e-4ac9-a1b3-4d2fed0f84c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:36.179246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bf5c-9d83-4083-bf9b-cd9a3a00bd48 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.220056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.221388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.221835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.222303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.223820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:36.225555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:36.228358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 45/103] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:36.230071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.253043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:36.286982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 59/104] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:36.289028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0ee6-ff2f-4db1-8ec4-e50f8e38e29d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.289520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0ee6-ff2f-4db1-8ec4-e50f8e38e29d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.289979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0ee6-ff2f-4db1-8ec4-e50f8e38e29d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.291439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 60/105] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:36.292725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad0ee6-ff2f-4db1-8ec4-e50f8e38e29d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.360926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bcb21-0f3e-4afe-a1a8-7f793a89e8f9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.378987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:36.397390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7b87-955d-4e49-9193-1d3ad47cfea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.398652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7b87-955d-4e49-9193-1d3ad47cfea6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.399087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7b87-955d-4e49-9193-1d3ad47cfea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.399508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7b87-955d-4e49-9193-1d3ad47cfea6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.410769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad0ee6-ff2f-4db1-8ec4-e50f8e38e29d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.411215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f7b87-955d-4e49-9193-1d3ad47cfea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8f8f7b87-955d-4e49-9193-1d3ad47cfea6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:36.419407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:36.420350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:36.421168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 46/106] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:36.422271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe79e7b-0d06-48e3-bb40-c1af64f8b6d6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.422271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe79e7b-0d06-48e3-bb40-c1af64f8b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.422564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe79e7b-0d06-48e3-bb40-c1af64f8b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.440176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4fe79e7b-0d06-48e3-bb40-c1af64f8b6d6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:36.441401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4fe79e7b-0d06-48e3-bb40-c1af64f8b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:36.447343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.448010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.448300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.448581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.449378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:36.450845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:36.491727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 61/107] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:54:36 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:36.494067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.527758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 47/108] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:36.529624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf1fd-8baf-42cf-a59a-313d67d69fdb None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.530112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf1fd-8baf-42cf-a59a-313d67d69fdb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.531208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf1fd-8baf-42cf-a59a-313d67d69fdb None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.534381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:36.534781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 48/109] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:36.537125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbf1fd-8baf-42cf-a59a-313d67d69fdb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.630275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792e26a-38ff-4677-988b-ff49cfbde05b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.670271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100fd0-9a38-4be3-8964-501a67e85bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.671166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100fd0-9a38-4be3-8964-501a67e85bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.671464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100fd0-9a38-4be3-8964-501a67e85bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.671750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100fd0-9a38-4be3-8964-501a67e85bd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.690744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100fd0-9a38-4be3-8964-501a67e85bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ba100fd0-9a38-4be3-8964-501a67e85bd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:36.698856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:36.699757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:36.700500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 62/110] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:36.701801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.701801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.702039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.713396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbf1fd-8baf-42cf-a59a-313d67d69fdb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.725381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:36.730552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:36.731771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:36.773221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.773221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.773914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.773914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.775989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:36.775989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:36.776721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:36.786028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 49/111] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:36.786636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.852847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 63/112] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:36.854385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.871009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:36.946230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f073c-0332-4109-b1d2-9bad6980e1dd None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.970908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46448fd1-c50e-45a6-853f-ea39ae67e6c8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.983440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.984536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.984644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.985493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.997376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:37.006535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:37.007426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:37.008171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 50/113] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:37.014038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.019946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.021032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.021552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.022060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.023058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:37.023619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.025460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.035768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 64/114] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.036965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.042298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.132993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.152750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a6dd7-75ef-4d0b-ab7e-57642db31e3f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.165989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19a2d4-c2f2-42d1-b1df-4c9eef3658ab None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.203455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.205470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.205871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.206266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.207662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.209298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.209460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.210417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.210836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.211246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.211713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 51/115] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.212586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.225823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:37.237956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:37.239016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:37.239930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:37.243032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 65/116] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:37.244291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.341945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.346866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1ea9-3a74-40a1-873b-51c3c014efa9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.373572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad8e4-2c80-4630-8ae5-99b7101a382c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.383526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.384291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.384670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.384993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.385814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:37.386132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.387552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.396587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 52/117] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.397494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.417163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.418456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.419022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.419446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.420833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.423312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.425395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 66/118] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.426473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.429086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.506222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35de4a-a166-4215-8535-ee3841bb6e66 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.534472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb117ea-1f71-40ec-8ddf-38a90bd7e102 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.540862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ffeda-7b2b-4f98-babd-fb831fae0882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ffeda-7b2b-4f98-babd-fb831fae0882 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.542087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ffeda-7b2b-4f98-babd-fb831fae0882 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.542381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ffeda-7b2b-4f98-babd-fb831fae0882 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.543666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ffeda-7b2b-4f98-babd-fb831fae0882 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.545174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ffeda-7b2b-4f98-babd-fb831fae0882 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.546891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 53/119] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.553131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abd1ff-8139-46b2-9698-824d9f7822a8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.553425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abd1ff-8139-46b2-9698-824d9f7822a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.553710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abd1ff-8139-46b2-9698-824d9f7822a8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.554993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 54/120] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:37.555701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abd1ff-8139-46b2-9698-824d9f7822a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.576635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.577352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.577643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.577924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.579243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:37.579674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.581166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.589631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.589760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 67/121] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.590558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.660146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.675215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abd1ff-8139-46b2-9698-824d9f7822a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.705595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5720aa-af02-468f-880e-fa170a6f4ef0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.713303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7a455-b468-4021-8566-010784ebe265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.714195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a455-b468-4021-8566-010784ebe265 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.714477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a455-b468-4021-8566-010784ebe265 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.714754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a455-b468-4021-8566-010784ebe265 None admin] PATH_INFO: `/v3/users/0a39f85e903e4df6a36c07d431671675` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.730001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7a455-b468-4021-8566-010784ebe265 None admin] RBAC: Authorizing `identity:get_user(user_id=0a39f85e903e4df6a36c07d431671675)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.731729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7a455-b468-4021-8566-010784ebe265 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.733399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 55/122] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/users/0a39f85e903e4df6a36c07d431671675 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.734409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.734693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.735056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.748221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.749299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.749590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.749877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.751173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.752651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.752785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:37.753911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:37.754586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 68/123] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:37.757520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.832478 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 56/124] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:37.833606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.861550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.872918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd36bb-64f5-4940-b563-554e033d79a6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.904803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:37.910238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.911069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.911392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.911627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/af2521f6f90246608eabb4e52c5296fb/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.913650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc419f19cc24b04ac728d5de53b8a4b, user_id=af2521f6f90246608eabb4e52c5296fb, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.915103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.930032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 69/125] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:37 2022] PUT /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/af2521f6f90246608eabb4e52c5296fb/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:37.931498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.953334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1ff94-2ce6-4c2f-8740-4bf0e8a3d87c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.002733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.004618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.005503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.006009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.008414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.010798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.019324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 57/126] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:38.021074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.082351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feac516-5f0c-4cc6-9a83-4db989b12898 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.133366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.134224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:38.134654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.134956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.135236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.153748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d87421-9541-40ae-8c20-3717cdefe277 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.219491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.220475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:38.222790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.223284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.223738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/cc4dc5eccddf4937ae7c342c241f1972/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.227645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc419f19cc24b04ac728d5de53b8a4b, user_id=cc4dc5eccddf4937ae7c342c241f1972, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.229846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.237950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.239856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.253382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 58/127] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:38 2022] PUT /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/cc4dc5eccddf4937ae7c342c241f1972/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:38.259290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.374916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 70/128] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:38.376535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.440465 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b32e32-7d26-425a-a556-e039b38ab7c5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.483858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.486555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.487053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.487542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.500270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:38.509908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:38.510854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:38.511647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:38.514393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 59/129] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:38.515672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.526712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:38.618819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:38.629065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a69ee-23dd-429a-b732-ee4dd042a31f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.646481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a825ea-d44e-4424-8cd7-8a84d00cda2d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.666843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.667719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.668011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.668295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.669610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.671087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.674215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 71/130] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:38 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:38.674752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.686328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.687803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.688361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.688936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.690523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.692207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.694227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 60/131] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:38 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:38.695183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.768965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:38.784331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435096-b24e-49b8-894e-c3018451b5ac None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.805909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762c835-4a97-448b-8b8e-95bf3e308ba1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.824097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.824824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.825116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.825397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.826170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:38.826485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.827892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.837773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 72/132] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:38.838878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.850228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.851144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.851432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.851716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/af2521f6f90246608eabb4e52c5296fb/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.854589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc419f19cc24b04ac728d5de53b8a4b, user_id=af2521f6f90246608eabb4e52c5296fb, role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.856546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.885017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 61/133] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:38 2022] PUT /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/af2521f6f90246608eabb4e52c5296fb/roles/f9187cfd078c4241b44e62a19296c815 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:38.885705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:38.889921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.042246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7629-1df4-4745-96b9-a72e0c8946c6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.067520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd3609-b593-4e13-9133-d8900bf6e06b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.097740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.098430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.098721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.099012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.099866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] RBAC: Adding query filter params (role.id=687a860c43a542f08981e3e28dd72891, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=0a39f85e903e4df6a36c07d431671675) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:39.100184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.101705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db1c6b-e094-408c-99d7-786de952f3cb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.118210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:39.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 73/134] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:38 2022] GET /identity/v3/role_assignments?user.id=0a39f85e903e4df6a36c07d431671675&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=687a860c43a542f08981e3e28dd72891 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:39.122956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a321a-157f-45b2-b8e6-b2e0a1636cbe None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.123083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a321a-157f-45b2-b8e6-b2e0a1636cbe None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.123357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a321a-157f-45b2-b8e6-b2e0a1636cbe None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.125123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 74/135] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:39.131142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.131463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.131719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.132494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.133640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.134181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.134674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.138936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.140854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.143454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 62/136] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:38 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:39.149867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.166073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:39.167745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:39.309318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 75/137] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:39.339852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.357566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481723-1dcb-4fd7-87e4-e0aaf57bd1af None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.365886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:39.417852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.418766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.419294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.419415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] PATH_INFO: `/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.420621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0ffc95fbf75c4ca4b2786c263582bafc)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.422138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.424418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 63/138] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:39 2022] GET /identity/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:39.429646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.482248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723f5e-4add-4447-ae4f-403d099d6275 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.525212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.526771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.527374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.527841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.529239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.530902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.533273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 76/139] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:39.540098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.578668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:39.664649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:39.682677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e399-d493-43f5-8c95-424d593789b8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.686456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fa5b3-7fe0-46f9-941e-08d7c8a737da None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.729421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201781b0-5046-411f-97b1-b95e957c1af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.730447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201781b0-5046-411f-97b1-b95e957c1af6 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.730926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201781b0-5046-411f-97b1-b95e957c1af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.731420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201781b0-5046-411f-97b1-b95e957c1af6 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.732414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201781b0-5046-411f-97b1-b95e957c1af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.734093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201781b0-5046-411f-97b1-b95e957c1af6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.757481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 77/140] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:39 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:39.757977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04044c82-a41a-4829-a357-aa21fad234ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.759045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04044c82-a41a-4829-a357-aa21fad234ca None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.759647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04044c82-a41a-4829-a357-aa21fad234ca None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.759647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04044c82-a41a-4829-a357-aa21fad234ca None admin] PATH_INFO: `/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc/users/af2521f6f90246608eabb4e52c5296fb/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.769739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04044c82-a41a-4829-a357-aa21fad234ca None admin] RBAC: Authorizing `identity:create_grant(project_id=0ffc95fbf75c4ca4b2786c263582bafc, user_id=af2521f6f90246608eabb4e52c5296fb, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.771414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04044c82-a41a-4829-a357-aa21fad234ca None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.800803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 64/141] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:39 2022] PUT /identity/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc/users/af2521f6f90246608eabb4e52c5296fb/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:40.840012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51db0-784d-4def-b7cc-b89f516c0500 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:40.841029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51db0-784d-4def-b7cc-b89f516c0500 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:40.841527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae51db0-784d-4def-b7cc-b89f516c0500 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:40.843093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 78/142] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:40.849504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:40.849965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:40.850147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:40.871506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:40.872744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:40.966461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 65/143] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:41.011713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae51db0-784d-4def-b7cc-b89f516c0500 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.177718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae51db0-784d-4def-b7cc-b89f516c0500 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.231872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.233060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.233550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.234081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.244265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:41.252352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:41.262643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:41.263510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:41.264283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:41.268942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 79/144] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:41.275119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.377430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:41.441530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87821f-19f8-4b76-aaf5-fe3e52959b09 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.482583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.483176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.483468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.483760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.484518 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:41.485517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.486937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.501391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 66/145] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:41.507278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.657553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d59ce-4539-4963-9be7-977e489c108c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.709564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.710847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.711136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.711466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.712899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.714523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.716644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 80/146] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:41.723375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.877475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff736d06-71ba-4731-a59b-4afb84e6150c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.903663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:41.928710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0850661-8133-4949-93a5-8c35cb76ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.929648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0850661-8133-4949-93a5-8c35cb76ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.930135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0850661-8133-4949-93a5-8c35cb76ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.930618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0850661-8133-4949-93a5-8c35cb76ac54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.028916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0850661-8133-4949-93a5-8c35cb76ac54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.030416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0850661-8133-4949-93a5-8c35cb76ac54 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.153768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 67/147] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:42.161761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.257042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:42.304804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a8519-b254-4408-8c03-b59a9533efb5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.353207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b4c48-62b3-49b0-ab1e-e35cb9fa7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.354099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4c48-62b3-49b0-ab1e-e35cb9fa7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.354388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4c48-62b3-49b0-ab1e-e35cb9fa7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.354667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4c48-62b3-49b0-ab1e-e35cb9fa7ef8 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.354819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba16d3-e078-431c-bb23-9e74e88ae633 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.354976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba16d3-e078-431c-bb23-9e74e88ae633 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.355226 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba16d3-e078-431c-bb23-9e74e88ae633 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.355918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b4c48-62b3-49b0-ab1e-e35cb9fa7ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.356798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 68/148] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:42.357415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b4c48-62b3-49b0-ab1e-e35cb9fa7ef8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.359106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 81/149] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:42.365250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba16d3-e078-431c-bb23-9e74e88ae633 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.368228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef377-dfd8-483e-b790-0902f4796377 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.368520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef377-dfd8-483e-b790-0902f4796377 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.368839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fef377-dfd8-483e-b790-0902f4796377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.393789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-28fef377-dfd8-483e-b790-0902f4796377 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:42.395594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-28fef377-dfd8-483e-b790-0902f4796377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:42.415334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:42.530697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba16d3-e078-431c-bb23-9e74e88ae633 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.586173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.586866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.587196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.587529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.588419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=af2521f6f90246608eabb4e52c5296fb) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:42.588751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.590498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.600200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 69/150] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/role_assignments?user.id=af2521f6f90246608eabb4e52c5296fb&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=81e2b7e27546405389402bc4b6987138 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:42.602994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 82/151] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:42.686114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.691257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bad6-ef29-45f8-bbd1-a9125330c5d9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.691980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bad6-ef29-45f8-bbd1-a9125330c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.692455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0bad6-ef29-45f8-bbd1-a9125330c5d9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.694503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 83/152] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:42.699646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.700157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.700658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.733713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:42.736458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:42.815150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:42.840043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42957076-efd0-41dd-9a56-d1aab790b9e0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.894958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.895827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.896117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.896389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.914487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:42.926168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:42.927117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:42.927891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 70/153] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:42.933364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:42.942834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.947030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 84/154] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:42.999887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.085768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943d942-f20b-4cbc-af7e-8c4b4a1d8e93 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.121546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.122224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.122504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.122776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.128703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:43.128703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:43.128703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf0c91-c7b9-4cb0-8729-b490a19e667b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:43.135894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 71/155] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:43.136201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f8bc5-a494-4781-88ad-89f9bea31a1e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.136461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f8bc5-a494-4781-88ad-89f9bea31a1e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.136770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f8bc5-a494-4781-88ad-89f9bea31a1e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.139782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 72/156] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:43.146303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f8bc5-a494-4781-88ad-89f9bea31a1e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.165054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:43.310850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f8bc5-a494-4781-88ad-89f9bea31a1e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.353593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5747d-4435-4974-9701-983087c993b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.354650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5747d-4435-4974-9701-983087c993b8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.354973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5747d-4435-4974-9701-983087c993b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.355345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5747d-4435-4974-9701-983087c993b8 None admin] PATH_INFO: `/v3/users/cc4dc5eccddf4937ae7c342c241f1972` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.356560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5747d-4435-4974-9701-983087c993b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4dc5eccddf4937ae7c342c241f1972)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:43.357476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d20447-a8a2-418b-b8d4-4bfd5d3157eb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.358091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5747d-4435-4974-9701-983087c993b8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:43.363341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 73/157] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:43 2022] GET /identity/v3/users/cc4dc5eccddf4937ae7c342c241f1972 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:43.363341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.363341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.363341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.386010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:43.387201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:43.464567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 74/158] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:43.465809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.481295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:43.506010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.507199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.507682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.508152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.542255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:43.551587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:43.552518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:43.553316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:43.557236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 85/159] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 556 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:43.558269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.593299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df271-37db-4c78-a663-3dfac3d5b55d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.636579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6fa5-da82-43aa-9356-74af0b7bb516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.637625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6fa5-da82-43aa-9356-74af0b7bb516 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.637915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6fa5-da82-43aa-9356-74af0b7bb516 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.638191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6fa5-da82-43aa-9356-74af0b7bb516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.657822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:43.686110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4d33c-4095-44b8-b5f2-f0f736919543 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.753946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f48d78-e22e-4d63-810e-671e6d3f9cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.756089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f48d78-e22e-4d63-810e-671e6d3f9cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.756815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f48d78-e22e-4d63-810e-671e6d3f9cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.758135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f48d78-e22e-4d63-810e-671e6d3f9cb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.779476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f48d78-e22e-4d63-810e-671e6d3f9cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d6f48d78-e22e-4d63-810e-671e6d3f9cb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:43.789700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:43.790636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:43.791386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:43.793736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6fa5-da82-43aa-9356-74af0b7bb516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:43.794050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 86/160] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:54:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:43.795418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6fa5-da82-43aa-9356-74af0b7bb516 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:43.795842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd623-9e05-480b-8b12-f4d2c3212253 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.796323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd623-9e05-480b-8b12-f4d2c3212253 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.796833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd623-9e05-480b-8b12-f4d2c3212253 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.798333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 87/161] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:43.799216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd623-9e05-480b-8b12-f4d2c3212253 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.799467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:43.997141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 75/162] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:44.000914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.001797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.002769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.003536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd623-9e05-480b-8b12-f4d2c3212253 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.037038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:44.040892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:44.042678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:44.067886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.068846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.069486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.070950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.071969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:44.072556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.076472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.098715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 88/163] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:44.099818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.184875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 76/164] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:44.187004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.255375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:44.313680 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a6051-93d7-4ae5-8e62-4eab98d4a7cc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.349258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30d14-69bd-4508-bbd8-c272fcf31ae3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.384861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.386492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.387406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.388302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.390030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:44.391535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.392453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.393565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.395158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.395590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.396014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.398711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.400308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.406270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 77/165] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:44.408071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.413830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 89/166] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:44.414858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.465497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:44.539369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fedf44-e6de-46eb-b01b-e061d9ded5ba None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.576867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.578324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.579250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.579523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.581746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83ddd-f5d7-4ebd-86d1-c0579c319530 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.583978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:44.598133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:44.610620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:44.614613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 90/167] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:44.615389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.627267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.628427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.628847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.629255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] PATH_INFO: `/v3/users/0a39f85e903e4df6a36c07d431671675` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.630749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] RBAC: Authorizing `identity:get_user(user_id=0a39f85e903e4df6a36c07d431671675)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.632415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.634683 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 78/168] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/users/0a39f85e903e4df6a36c07d431671675 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:44.635722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.737941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:44.741733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e965-d910-4585-9994-3c5b733ac33a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.772960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef4d3-9ef3-408d-a784-f29f89e89071 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.785159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.786052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.786494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.786980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.788014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=cc4dc5eccddf4937ae7c342c241f1972) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:44.788528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.790272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa410176-d513-4a01-9d7a-93dec94f951d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.796852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 91/169] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/role_assignments?user.id=cc4dc5eccddf4937ae7c342c241f1972&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:44.799901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda91bab-7916-48e3-89ce-352e1d0b03d1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.800454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda91bab-7916-48e3-89ce-352e1d0b03d1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.800976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda91bab-7916-48e3-89ce-352e1d0b03d1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.802606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 92/170] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:44.803683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda91bab-7916-48e3-89ce-352e1d0b03d1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.824230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.825544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.826030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.826504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.828119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.835353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.845533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 79/171] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:44.846852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.918751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:44.991619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda91bab-7916-48e3-89ce-352e1d0b03d1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.036079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f06a-4644-48c7-8942-01adbb5aae24 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.056022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.056636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.057058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.057342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.058110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:45.058429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.059820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c770-179c-4f9d-a6cf-0ee4bd10c8f6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.069625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 93/172] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:45.070893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.071185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.071465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.078116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.079871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.080171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.080496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.081706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.084587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.086566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 80/173] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:44 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:45.087152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.099323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:45.100519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:45.124878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.184106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 94/174] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:45.184787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.210332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fcdd7-d003-4f9f-8792-98efed174ac0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.217977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.246000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e165-ae44-4c7a-a994-4cb1cc84c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.246656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e165-ae44-4c7a-a994-4cb1cc84c678 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.246939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e165-ae44-4c7a-a994-4cb1cc84c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.247214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e165-ae44-4c7a-a994-4cb1cc84c678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.289947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6aff9-e622-4e3e-93a5-e969a8d23d2a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.316196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01e165-ae44-4c7a-a994-4cb1cc84c678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.317729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01e165-ae44-4c7a-a994-4cb1cc84c678 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.323437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.324303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.324588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.324893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] PATH_INFO: `/v3/users/af2521f6f90246608eabb4e52c5296fb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.326089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] RBAC: Authorizing `identity:get_user(user_id=af2521f6f90246608eabb4e52c5296fb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.327540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.329949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 95/175] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:45 2022] GET /identity/v3/users/af2521f6f90246608eabb4e52c5296fb => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:45.330462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.359476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.417601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 81/176] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:45.418935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749637ea-5c9e-4941-ab99-aa5642167817 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.419227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749637ea-5c9e-4941-ab99-aa5642167817 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.419506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749637ea-5c9e-4941-ab99-aa5642167817 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.420799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 82/177] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:45.421931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47220f85-0917-4c91-ad86-d9e739536e3e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.422290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47220f85-0917-4c91-ad86-d9e739536e3e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.422715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47220f85-0917-4c91-ad86-d9e739536e3e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.423937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 83/178] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:45.424641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47220f85-0917-4c91-ad86-d9e739536e3e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.433364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.446468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a3eb-df19-4d8b-b619-de9c05d14213 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.482607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.483491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.483775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.484053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/0a39f85e903e4df6a36c07d431671675/roles/687a860c43a542f08981e3e28dd72891` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.486174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc419f19cc24b04ac728d5de53b8a4b, user_id=0a39f85e903e4df6a36c07d431671675, role_id=687a860c43a542f08981e3e28dd72891)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.487632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.501754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 96/179] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:45 2022] PUT /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/users/0a39f85e903e4df6a36c07d431671675/roles/687a860c43a542f08981e3e28dd72891 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:45.503004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.529237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47220f85-0917-4c91-ad86-d9e739536e3e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.572498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.573304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.573589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.573882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.586185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:45.594067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:45.595218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:45.596012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 84/180] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:45.596854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.618478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.637729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612e9a-1c7d-4c35-bc9f-aa40556eb979 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.686625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.687582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.688379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.688379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.690266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.732147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fba3f-9123-4bc8-a12e-94ee7dfaf888 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.765400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.767441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.773566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193638a-9e21-4e60-a7a5-e25673d52b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.774434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193638a-9e21-4e60-a7a5-e25673d52b0f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.774720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193638a-9e21-4e60-a7a5-e25673d52b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.774995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193638a-9e21-4e60-a7a5-e25673d52b0f None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.776669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193638a-9e21-4e60-a7a5-e25673d52b0f None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.778897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193638a-9e21-4e60-a7a5-e25673d52b0f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.786113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 85/181] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:45 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:45.786113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9ad4-2774-47b7-ac93-c54c33ec50fd None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.786113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9ad4-2774-47b7-ac93-c54c33ec50fd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.786113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9ad4-2774-47b7-ac93-c54c33ec50fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.801972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-666a9ad4-2774-47b7-ac93-c54c33ec50fd None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:45.803276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-666a9ad4-2774-47b7-ac93-c54c33ec50fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:45.863591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.883290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 86/182] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:45.884378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.884668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.884987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.895439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 97/183] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:45.908735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.914159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:45.916261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:45.991000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.012710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 87/184] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:46.012710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.032157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369c8a6-8c35-40b5-b790-b0c8c4922944 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.072979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.073649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.073928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.074201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.074945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:46.075253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.076611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.084856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 98/185] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.085641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.117990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a225-99b9-4c60-8f95-8c8968f1b8f0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.143051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.155112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.155548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.155829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.156108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.157529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] RBAC: Adding query filter params (role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=af2521f6f90246608eabb4e52c5296fb) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:46.157940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.159430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.165757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 88/186] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/role_assignments?user.id=af2521f6f90246608eabb4e52c5296fb&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=f9187cfd078c4241b44e62a19296c815 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.166677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.231075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aa0f5-5c90-4d35-bfea-1ddfc4f5028f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.258604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.272257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.273140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.273492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.273862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] PATH_INFO: `/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.275382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] RBAC: Authorizing `identity:get_project(project_id=0ffc95fbf75c4ca4b2786c263582bafc)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.276982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.279021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 99/187] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/projects/0ffc95fbf75c4ca4b2786c263582bafc => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.280097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.322109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780461b-f8ac-4994-8017-c106701ca73d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.368667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.370399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.371112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.371941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.374440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.376401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.378991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 89/188] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.380196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.409627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac123477-204c-4c44-b8f9-8ee043947b22 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.430630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.452662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.454351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.454650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.456792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.474869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:46.483209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:46.489220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 100/189] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:46.490128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.517703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7e2e-89f8-4e97-8614-9aa906b45750 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.553354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.565168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.566022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.566314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.568510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] PATH_INFO: `/v3/users/eb50204565654857a6fedd9d32e94111` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.590729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] RBAC: Authorizing `identity:get_user(user_id=eb50204565654857a6fedd9d32e94111)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.594970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.596757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 90/190] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/users/eb50204565654857a6fedd9d32e94111 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.598107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.634574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39fa7-d4a7-408e-a437-dfcc65994aa6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.687836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.689014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.689527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.690039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.691617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=0ffc95fbf75c4ca4b2786c263582bafc, user.id=af2521f6f90246608eabb4e52c5296fb) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:46.691945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.693452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.700226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 101/191] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/role_assignments?user.id=af2521f6f90246608eabb4e52c5296fb&scope.project.id=0ffc95fbf75c4ca4b2786c263582bafc&role.id=81e2b7e27546405389402bc4b6987138 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.709841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.735966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451a1f-4c04-406f-8192-65f9b3716c4a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.776320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.783269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.784331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.784853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.785350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.786320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.788245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.817114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 91/192] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:46.818711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.883880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.911100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ed45-9697-46df-8447-dda91c9325d4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.971644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba942e-94ea-4582-94d8-c4627329dc6d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.982818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.983295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.983586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.983915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.985056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:46.985382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.990985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.009878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 102/193] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:47.016482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.021587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.023581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.024027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.024521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.143828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.146246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.168602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.174813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38dd2-5c28-41f1-a1fa-3db7ebb3206f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.200437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.225711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.226773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.226773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.226959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] PATH_INFO: `/v3/users/eb50204565654857a6fedd9d32e94111` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.228130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] RBAC: Authorizing `identity:get_user(user_id=eb50204565654857a6fedd9d32e94111)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.229679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.231566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 103/194] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/users/eb50204565654857a6fedd9d32e94111 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:47.237055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.271635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 92/195] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:47.278432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.365070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700cca-9166-4ef3-92ec-05ad27185f02 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.413603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1c21-9eb3-4e5e-9e99-d523ae8ca104 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.417373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.418033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.418314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.418594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.466127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.467292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.468653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.469225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.469787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.471280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.473580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.476261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 93/196] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:47.482875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.498861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.509042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.510542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.622888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714e69-9a25-4029-8bc4-0ce51bb60a62 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.623943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 104/197] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:54:47.630066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.674765 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.676265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.680199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.680665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.681732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=eb50204565654857a6fedd9d32e94111) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:47.682191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.684521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.695181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 94/198] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/role_assignments?user.id=eb50204565654857a6fedd9d32e94111&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:47.719983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.767879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4f7a-c077-48dd-a11d-62c38137b0cd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.818710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec51da-9da2-4142-947e-fdfdd497f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.819907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec51da-9da2-4142-947e-fdfdd497f585 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.820365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec51da-9da2-4142-947e-fdfdd497f585 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.820806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec51da-9da2-4142-947e-fdfdd497f585 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.822255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec51da-9da2-4142-947e-fdfdd497f585 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.823927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec51da-9da2-4142-947e-fdfdd497f585 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.825942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 105/199] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:47.833177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.909514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ad8a-2560-448b-b290-43d0a7af05a1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.910032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ad8a-2560-448b-b290-43d0a7af05a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.910448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64ad8a-2560-448b-b290-43d0a7af05a1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.912303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 106/200] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:47.919077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.919754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.920226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.923911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.940867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:47.942406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:47.974297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad6397-7229-49e9-83d2-e0dab31a8ab8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.015415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.016347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.016641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.016969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.017822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] RBAC: Adding query filter params (role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=eb50204565654857a6fedd9d32e94111) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:48.018255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.019832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:48.026452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 95/201] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/role_assignments?user.id=eb50204565654857a6fedd9d32e94111&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=f9187cfd078c4241b44e62a19296c815 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:48.036850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 107/202] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:48.057212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.219479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301841-f111-456b-a8bc-18dedd72650a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.271555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.272302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.272587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.272900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.277581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:48.289388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:48.297823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:48.298899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:48.299680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 96/203] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:48.308648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.382228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:48.427773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cb1d2-5507-4649-a92b-9a61f96f422b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.463346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.464017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.464298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.464569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.465344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:48.465645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.467012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:48.476181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 108/204] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:48.481911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.606510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aec7f8-dac6-48d8-bc3a-f5c3b31b51d5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.643557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.644442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.644744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.645019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] PATH_INFO: `/v3/users/0a39f85e903e4df6a36c07d431671675` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.646223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] RBAC: Authorizing `identity:get_user(user_id=0a39f85e903e4df6a36c07d431671675)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.647689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:48.649497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 97/205] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:48 2022] GET /identity/v3/users/0a39f85e903e4df6a36c07d431671675 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:48.655052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.780017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2640ae-22cf-4830-aa32-b19f8d302db6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.807063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:48.819719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.820760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.821394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.821671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.916283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.917700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.049876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 109/206] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:49.055814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.160953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:49.214289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f65be1-55d6-4c1d-86e1-428f25dd87f4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.271790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929f005-0113-478f-8304-2491235b7742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.272668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929f005-0113-478f-8304-2491235b7742 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.272984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929f005-0113-478f-8304-2491235b7742 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.273262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929f005-0113-478f-8304-2491235b7742 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.274453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929f005-0113-478f-8304-2491235b7742 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.282795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929f005-0113-478f-8304-2491235b7742 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.284876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 98/207] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:49.291041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.340453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:49.450333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54a989-31d0-4416-8698-03f10c3fb7dc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.500627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.501456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.501456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.501604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.502357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] RBAC: Adding query filter params (role.id=687a860c43a542f08981e3e28dd72891, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b, user.id=0a39f85e903e4df6a36c07d431671675) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:49.502662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.504110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4256fae-cead-442e-bce9-3861bc35a0ee None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.510258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 110/208] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/role_assignments?user.id=0a39f85e903e4df6a36c07d431671675&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=687a860c43a542f08981e3e28dd72891 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:49.996258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c48145-63aa-4a31-b914-3652eedaca9c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.996630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c48145-63aa-4a31-b914-3652eedaca9c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.996844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c48145-63aa-4a31-b914-3652eedaca9c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.998473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 99/209] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:50.004325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.004617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.004920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.025284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:50.026818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:50.035052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6269d-06fc-4d9e-9c5f-022c02033b92 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.035341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6269d-06fc-4d9e-9c5f-022c02033b92 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.035626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6269d-06fc-4d9e-9c5f-022c02033b92 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.037186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 100/210] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:50.045410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.045410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.045410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.074196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:50.075736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:50.108220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 111/211] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:50.132207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.159361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 101/212] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:50.162365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:50.189286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.258421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca913-3e45-4df6-95ac-9b192e0de3dd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.267070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:50.301299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.302980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.303743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.304225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.316985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07f9f-4c66-4e3e-a8b3-978c6e8e7407 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.321988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:50.333568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:50.334660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:50.335638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:50.338112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 112/213] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:50.344150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.363349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.364302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.364805 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.365179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.366559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.368115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.374742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 102/214] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:50.376707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.462674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:50.483858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d538245-7847-4325-b6e2-6051cc74a0ec None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.509384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f0ee2-da6c-4052-b2b8-9c1b04e40107 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.522652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.523997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.524505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.525005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.525980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:50.526491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.528071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.536991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 113/215] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:50.543463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.546232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:50.555762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8bf5b-7041-4433-a7c7-e321eff05507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.556453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8bf5b-7041-4433-a7c7-e321eff05507 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.556768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8bf5b-7041-4433-a7c7-e321eff05507 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.557049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8bf5b-7041-4433-a7c7-e321eff05507 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.558267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8bf5b-7041-4433-a7c7-e321eff05507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.559742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8bf5b-7041-4433-a7c7-e321eff05507 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.592753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 103/216] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:50 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:50.607572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c576d-3da6-44b2-9ab9-faae2954cb88 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.608245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c576d-3da6-44b2-9ab9-faae2954cb88 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.608553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c576d-3da6-44b2-9ab9-faae2954cb88 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.610783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 104/217] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:50.616631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.616959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.617282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.638247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:50.639754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:50.687886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d618de-c328-4237-854e-d2f045476f66 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.729742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 105/218] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:50.737084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.737979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.738433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.738712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] PATH_INFO: `/v3/users/89149277a2fa43dfaa6ba2415ce9fa6d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.753695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.755222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] RBAC: Authorizing `identity:get_user(user_id=89149277a2fa43dfaa6ba2415ce9fa6d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.758090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.760055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 114/219] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/users/89149277a2fa43dfaa6ba2415ce9fa6d => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:50.765577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.771890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:50.883885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829873a-6943-4348-9895-3f6f4ebf398d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.890659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6329c-c505-4e8d-b625-269d990cabb9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.905727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:50.940291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672d264-1a3a-44d2-8817-40529fc30e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.941267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.941656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672d264-1a3a-44d2-8817-40529fc30e0e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.942119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.942232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672d264-1a3a-44d2-8817-40529fc30e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.942587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.942763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672d264-1a3a-44d2-8817-40529fc30e0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.943042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.959305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672d264-1a3a-44d2-8817-40529fc30e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7672d264-1a3a-44d2-8817-40529fc30e0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:50.967173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:50.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:50.969136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 106/220] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:50.970914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765f90-cf9f-4819-9b74-bb44c0542be0 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.970914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765f90-cf9f-4819-9b74-bb44c0542be0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.971053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765f90-cf9f-4819-9b74-bb44c0542be0 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.972626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 107/221] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:50.977992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.978363 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.978541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.997899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:50.999153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:51.032130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.033713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.035969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.085815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 108/222] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:51.086860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.152068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 115/223] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:54:51.154660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.231404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed583f-8e28-4da9-a7b1-06e909fb33c5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.240150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.271114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.272275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.272842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.273296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.274129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:51.274658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.276730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.281303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a090f11-ea75-4ace-9b6e-0d9dc24282e0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.285113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.292298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 109/224] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:51.292298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.326386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.327700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.328777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.329849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.349501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:51.363560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:51.364466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:51.365288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:51.369041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 116/225] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:51.371283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.409603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90efb7-b39d-4423-b103-152d540dbbda None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.446120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.446990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.447273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.447541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.448773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.450224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.452298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 110/226] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:51.453242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.491481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.509846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835cac-2d2e-42c1-a985-17a6350588da None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.557269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.558582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.558972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.559353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] PATH_INFO: `/v3/users/eb50204565654857a6fedd9d32e94111` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.561389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] RBAC: Authorizing `identity:get_user(user_id=eb50204565654857a6fedd9d32e94111)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.564092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.566944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 117/227] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/users/eb50204565654857a6fedd9d32e94111 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:51.568100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.573256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab866d-d3eb-4145-86f5-3f35f2aa50aa None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.611277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.614103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.615034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.615493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.615943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.617180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:51.617719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.619457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.630776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 111/228] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:51.631965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.714041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565728e-3ec0-432d-a352-7e4599af7076 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.752339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.755060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.755725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.756059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.756352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.756752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6bb5-911d-4378-b15c-90e3fa013e0d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.757326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=89149277a2fa43dfaa6ba2415ce9fa6d) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:51.757646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.760189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.767209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 118/229] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/role_assignments?user.id=89149277a2fa43dfaa6ba2415ce9fa6d&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=81e2b7e27546405389402bc4b6987138 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:51.768178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.798050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.799541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.800256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.800256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.802813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.806446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.808817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 112/230] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:51.815825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.941905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276a87c-a9e5-48b1-b954-6792b61292b7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.981338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.985425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.986939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.987233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.987512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/eb50204565654857a6fedd9d32e94111/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.989756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad1119d2ddd4192a76bae766e50e3dd, user_id=eb50204565654857a6fedd9d32e94111, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.992250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.995755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6ea10-4377-405a-883b-e2049fa9e06e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.018099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 113/231] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:51 2022] PUT /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/eb50204565654857a6fedd9d32e94111/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:52.054535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.055579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.055867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.056147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] PATH_INFO: `/v3/users/eb50204565654857a6fedd9d32e94111` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.057411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] RBAC: Authorizing `identity:get_user(user_id=eb50204565654857a6fedd9d32e94111)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.059927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.061685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 119/232] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/users/eb50204565654857a6fedd9d32e94111 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:52.067973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.106857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:52.219576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f88e-3c45-41ab-8c5c-4922a2477b74 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.266148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838fd3-d82b-465a-9990-5e4598263526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.267029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838fd3-d82b-465a-9990-5e4598263526 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.267313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838fd3-d82b-465a-9990-5e4598263526 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.267588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838fd3-d82b-465a-9990-5e4598263526 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.268841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838fd3-d82b-465a-9990-5e4598263526 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.270313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838fd3-d82b-465a-9990-5e4598263526 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.272025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 114/233] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:52 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:52.277831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.389710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85318-b8c8-4190-ab0b-52f05893f238 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.436369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ef1fa-b6f5-4284-926f-7dec42d2a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.437551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ef1fa-b6f5-4284-926f-7dec42d2a931 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.438385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ef1fa-b6f5-4284-926f-7dec42d2a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.438662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ef1fa-b6f5-4284-926f-7dec42d2a931 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/eb50204565654857a6fedd9d32e94111/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.442498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ef1fa-b6f5-4284-926f-7dec42d2a931 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad1119d2ddd4192a76bae766e50e3dd, user_id=eb50204565654857a6fedd9d32e94111, role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.443980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ef1fa-b6f5-4284-926f-7dec42d2a931 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.473025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 120/234] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:52 2022] PUT /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/eb50204565654857a6fedd9d32e94111/roles/f9187cfd078c4241b44e62a19296c815 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:53.138152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c269d-94e4-4a42-ba06-3e9f2ebcbb2a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.138692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c269d-94e4-4a42-ba06-3e9f2ebcbb2a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.138692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c269d-94e4-4a42-ba06-3e9f2ebcbb2a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.140069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 115/235] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:53.145638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.146049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.146221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.165048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:53.166248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.185441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.241439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 121/236] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:53.275589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e7dc-ad64-4805-9b45-5346febfa635 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.275868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e7dc-ad64-4805-9b45-5346febfa635 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.276133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e7dc-ad64-4805-9b45-5346febfa635 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.277672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 116/237] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:53.278533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.288938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.289228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.289512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.317072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:53.318269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.435709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 117/238] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:53.461620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.476187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4523-f7fe-4195-b81c-2402849336ad None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.493134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.557462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.558199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.558484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.558758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.571754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c399ec5-8596-4ae5-8dd6-05a89b5e4f4f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.582557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:53.606403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:53.607346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:53.608125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 122/239] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:53.612018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.613119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.613622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.614381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.615800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.617546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.617656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.619501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 118/240] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:53.625020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.665063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.775010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698efc-f8eb-4964-8351-0c068cfb89e6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.814463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.815786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.816625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.817746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.819055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:53.819584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.821704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.822798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.835697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 123/241] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:53.840834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.841586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf2747-c625-4d53-b32e-8fd480369b4b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.929078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.929384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.930174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.930443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.930996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.931427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.932940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.962497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf90eee-9b8f-4ef3-9c58-83fad208a1be None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.981702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 119/242] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:54.020427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.021718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.022234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.022714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] PATH_INFO: `/v3/users/29d958c358ad4eb19f270ee801e3fe41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.048278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] RBAC: Authorizing `identity:get_user(user_id=29d958c358ad4eb19f270ee801e3fe41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.050298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.052557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 124/243] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:53 2022] GET /identity/v3/users/29d958c358ad4eb19f270ee801e3fe41 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:54.061824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.242551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523de94-5e43-4979-9ace-35a0a5dd894b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.285106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.285771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.286055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.286329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.309501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:54.378392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.379882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.498217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 120/244] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:54.505372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.631277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b725cac-f320-41de-a212-835af0a9238d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.663528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:54.668635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cf766-e994-4207-80ab-e8042139c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.671475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cf766-e994-4207-80ab-e8042139c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.671475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cf766-e994-4207-80ab-e8042139c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.671475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cf766-e994-4207-80ab-e8042139c6d2 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.681962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cf766-e994-4207-80ab-e8042139c6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.683536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cf766-e994-4207-80ab-e8042139c6d2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.685747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 125/245] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:54.693167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.696641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0975f-4614-4840-aafa-41ad83a34a44 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.696959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0975f-4614-4840-aafa-41ad83a34a44 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.697239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0975f-4614-4840-aafa-41ad83a34a44 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.698895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 126/246] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:54.705235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.705679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.705966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.725172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:54.726376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:54.786040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:54.811195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 127/247] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:54.841700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.843674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f99c-f4a3-4aa4-a9ae-841c966518ab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.883700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.884308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.884591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.884892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.885724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] RBAC: Adding query filter params (role.id=687a860c43a542f08981e3e28dd72891, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=29d958c358ad4eb19f270ee801e3fe41) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:54.886208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.887790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.896065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 121/248] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/role_assignments?user.id=29d958c358ad4eb19f270ee801e3fe41&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=687a860c43a542f08981e3e28dd72891 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:54.963300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e68a-b585-4774-b88d-29f1df4781f1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.998403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:55.007275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7dc9-0e40-4f46-8f68-1e3a0c969e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.008097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7dc9-0e40-4f46-8f68-1e3a0c969e39 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.008386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7dc9-0e40-4f46-8f68-1e3a0c969e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.008665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7dc9-0e40-4f46-8f68-1e3a0c969e39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.022895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c7dc9-0e40-4f46-8f68-1e3a0c969e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e28c7dc9-0e40-4f46-8f68-1e3a0c969e39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:55.030842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:55.031827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:55.032633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:55.036787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 128/249] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:55.038500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.061754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035ac42-89be-4fcd-b01d-39a586e677f7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.062096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035ac42-89be-4fcd-b01d-39a586e677f7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.062675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035ac42-89be-4fcd-b01d-39a586e677f7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.065102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 129/250] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:55.078846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.079146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.079393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.115337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:55.116661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:55.202507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666987-0caa-40b3-b6f6-99de6953c277 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:55.223865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:55.263165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.264632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.265134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.265733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.267277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:55.267804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:55.269419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:55.284617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 122/251] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:55.290071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 130/252] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:55.290410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.329847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.430973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929cd8-1c1b-4df5-bc46-cd76d48e443b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:55.473531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.474740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.475216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.475702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] PATH_INFO: `/v3/users/89149277a2fa43dfaa6ba2415ce9fa6d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.477120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] RBAC: Authorizing `identity:get_user(user_id=89149277a2fa43dfaa6ba2415ce9fa6d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:55.479097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:55.481302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 123/253] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/users/89149277a2fa43dfaa6ba2415ce9fa6d => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:55.489891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.561727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:55.590949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2f8aa-fd24-4abf-b194-7d1fed1f2b74 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:55.618071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b127cb-99e0-4548-b3ad-2abd2680ed2d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:55.641136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:55.654687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032faf2-cbca-4b7d-9a30-60dd3fb35c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.655905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032faf2-cbca-4b7d-9a30-60dd3fb35c03 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.656493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032faf2-cbca-4b7d-9a30-60dd3fb35c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.657013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032faf2-cbca-4b7d-9a30-60dd3fb35c03 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.658627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032faf2-cbca-4b7d-9a30-60dd3fb35c03 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:55.660418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032faf2-cbca-4b7d-9a30-60dd3fb35c03 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:55.662538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 124/254] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:55.664099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379c55-dbf2-4fe4-ac71-93e73f96011d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.664664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379c55-dbf2-4fe4-ac71-93e73f96011d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.664952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698e227-0b4b-4e28-a7ba-84d6922d0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.665381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379c55-dbf2-4fe4-ac71-93e73f96011d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.665757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698e227-0b4b-4e28-a7ba-84d6922d0851 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.666042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698e227-0b4b-4e28-a7ba-84d6922d0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.666315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698e227-0b4b-4e28-a7ba-84d6922d0851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.668156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 125/255] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:55.669149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379c55-dbf2-4fe4-ac71-93e73f96011d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.683783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698e227-0b4b-4e28-a7ba-84d6922d0851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8698e227-0b4b-4e28-a7ba-84d6922d0851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:55.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:55.693356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:55.694562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 131/256] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:55.695469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.695469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.695469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.714026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:55.715203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:55.789338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 132/257] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:55.790558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.830763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379c55-dbf2-4fe4-ac71-93e73f96011d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:55.853296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:55.893359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.894613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.895121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.895608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/89149277a2fa43dfaa6ba2415ce9fa6d/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.901963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad1119d2ddd4192a76bae766e50e3dd, user_id=89149277a2fa43dfaa6ba2415ce9fa6d, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:55.903293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5999-7c74-45b4-93f1-fbcfedc19fc8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:55.903846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:55.929558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:55.940700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 126/258] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:55 2022] PUT /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/89149277a2fa43dfaa6ba2415ce9fa6d/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:55.941543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:55.941862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:55.942229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:55.942506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:55.942854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:55.943634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:55.943998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:55.945527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:55.957773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 133/259] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:55.964253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.170202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9e6e6-4813-4bfd-8298-7b3d9bc9a3b9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.183508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122489c1-bd82-40c4-8b47-b81a6671bc64 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.243468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.244354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.244636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.244943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] PATH_INFO: `/v3/users/eb50204565654857a6fedd9d32e94111` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.246387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] RBAC: Authorizing `identity:get_user(user_id=eb50204565654857a6fedd9d32e94111)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:56.247849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:56.251915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.252780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.252946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 134/260] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/users/eb50204565654857a6fedd9d32e94111 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:56.253060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.253331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.259190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.265309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:56.275548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:56.276773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:54:56.278139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:56.279676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 127/261] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:54:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:54:56.284850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.311541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:56.322836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:56.383194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3d733-1610-4ac9-92c0-76f8c076f320 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.420937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.421514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.421803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.422782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.478837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d75ec-64d9-4add-8086-a3beefeb0d23 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.498274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:56.499893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:56.549187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:56.605205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.606150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.606579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.607018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.607929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:56.608467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:56.610765 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:56.619691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 135/262] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:54:56.620786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.635146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 128/263] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:54:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:56.641788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.732076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbb614-e4c7-46a7-ba38-84d5c0e9cece None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.772701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.772701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.772701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.772701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.773112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:56.773181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:56.774981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 136/264] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:56 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:56.780769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.793959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:56.854015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:56.877086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4090e0-f1c8-4fdc-a2ad-d1ced8590828 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.900745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5192c-2f36-4307-97c7-d88b6a4abe99 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:56.950151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.950775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.951060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.951383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.952281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=eb50204565654857a6fedd9d32e94111) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:56.952532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:56.954683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:56.965483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 137/265] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:56 2022] GET /identity/v3/role_assignments?user.id=eb50204565654857a6fedd9d32e94111&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:56.970450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:56.971377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:56.971661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:56.971941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] PATH_INFO: `/v3/users/eb50204565654857a6fedd9d32e94111` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:56.973284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] RBAC: Authorizing `identity:get_user(user_id=eb50204565654857a6fedd9d32e94111)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:56.974787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:56.982385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:56.982902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 129/266] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:56 2022] GET /identity/v3/users/eb50204565654857a6fedd9d32e94111 => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:57.100651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:57.132913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455c0a9-dcf2-4061-ac93-88cf96416716 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.171049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.171706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.172768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.173102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.247667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.249133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.342901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:57.356558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 138/267] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:54:57.362348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.511425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55515-ff4e-4ee5-9669-2534387a05ac None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.555667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393340e2-c401-4481-bf56-6bfae9bb4b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.556549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393340e2-c401-4481-bf56-6bfae9bb4b2c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.556869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393340e2-c401-4481-bf56-6bfae9bb4b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.557220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393340e2-c401-4481-bf56-6bfae9bb4b2c None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.558352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393340e2-c401-4481-bf56-6bfae9bb4b2c None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.559822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393340e2-c401-4481-bf56-6bfae9bb4b2c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.561864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 130/268] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:57 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:57.568464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.707444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e2b9a-5f21-4065-9a03-d025ff053b1e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.725348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a770-8b80-4380-999e-bc84ecb2de98 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.725757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a770-8b80-4380-999e-bc84ecb2de98 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.725947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a770-8b80-4380-999e-bc84ecb2de98 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.727630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 131/269] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:57.732763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a08c-201d-42b5-b02e-1e4c5175fe44 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.733063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a08c-201d-42b5-b02e-1e4c5175fe44 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.733348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a08c-201d-42b5-b02e-1e4c5175fe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.769832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-64f6a08c-201d-42b5-b02e-1e4c5175fe44 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:57.771418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-64f6a08c-201d-42b5-b02e-1e4c5175fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:57.786222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.786895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.787235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.787515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.788428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] RBAC: Adding query filter params (role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=eb50204565654857a6fedd9d32e94111) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:57.788812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.790299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.806210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 139/270] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:54:57 2022] GET /identity/v3/role_assignments?user.id=eb50204565654857a6fedd9d32e94111&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=f9187cfd078c4241b44e62a19296c815 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:57.825139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:57.908312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 132/271] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:54:57.942446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.002194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.017532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35cd5-26a1-4763-95bb-c789e9cb9132 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.017851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35cd5-26a1-4763-95bb-c789e9cb9132 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.018101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35cd5-26a1-4763-95bb-c789e9cb9132 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.023517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 133/272] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:58.027660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.027947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.028225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.059274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:58.061546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:58.076758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2672e-e14d-4ffb-80df-286426310a30 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.118223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.119405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.119892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.120492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.122168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.123971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.127135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 140/273] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:54:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:58.133045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.145252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 134/274] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:58.175152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.284212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.286839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f2f1-ae01-432e-afe2-e88a86c8a63e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.291060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.298880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f1c1a-c034-4fd3-9f9b-d52842a9cf02 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.334691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270be927-9492-4b5c-b662-485ea1de632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.335375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be927-9492-4b5c-b662-485ea1de632f None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.335658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be927-9492-4b5c-b662-485ea1de632f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.335935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be927-9492-4b5c-b662-485ea1de632f None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.336641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270be927-9492-4b5c-b662-485ea1de632f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.338116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270be927-9492-4b5c-b662-485ea1de632f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.340100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.340923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.341207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.341483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.353848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:58.359305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 141/275] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:54:58 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:58.362767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:58.363959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:54:58.364888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 135/276] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:58.368984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c8eb2-5a5c-46c9-af7c-874c09c0460b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.369305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c8eb2-5a5c-46c9-af7c-874c09c0460b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.369591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c8eb2-5a5c-46c9-af7c-874c09c0460b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.370494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.371124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 142/277] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:54:58.377042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.377370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.377609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.397987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:58.399199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:58.489449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 143/278] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:58.512084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.528063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9243dfa-57eb-40f6-bb9d-f2038bbde872 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.575006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.575684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.575967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.576647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.577076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:58.577377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.579462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.591088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 136/279] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:58.597210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.614163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.636625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.649010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da0259-218f-4a25-972a-3455486980a7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.700396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.701835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.702343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.702968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.717189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:58.726146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:58.727039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:58.727827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 144/280] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:58.735111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69874da-3c5c-4ad4-b9ee-d53923d2ffd3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.739634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.778603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.779494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.779776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.780045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] PATH_INFO: `/v3/users/ae4fb002c7fd4fd5860bf1174706e209` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.796082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4fb002c7fd4fd5860bf1174706e209)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.798306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.800209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 137/281] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/users/ae4fb002c7fd4fd5860bf1174706e209 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:58.805819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.863168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13927-746d-42c9-81d8-dddd82ae78eb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.895276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.903454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.904251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.904539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.904866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.905628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:58.905936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.907959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.918107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 145/282] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:58.925994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.940150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af26ac8-69f6-4942-a77b-6a3a621c21f3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.944178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.990303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.991067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.991573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.991924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.993425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, user.id=ae4fb002c7fd4fd5860bf1174706e209, scope.system=all) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:58.993747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.995673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:59.003358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 138/283] 10.222.0.31 () {56 vars in 1308 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/role_assignments?user.id=ae4fb002c7fd4fd5860bf1174706e209&scope.system=all&role.id=81e2b7e27546405389402bc4b6987138 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:59.053814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35243ce8-d551-46bc-b675-faa9b2ee07b9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:59.111299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59e39c-dd83-448a-97a4-63060598adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:59.112285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e39c-dd83-448a-97a4-63060598adc8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.112566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e39c-dd83-448a-97a4-63060598adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.112951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e39c-dd83-448a-97a4-63060598adc8 None admin] PATH_INFO: `/v3/users/29d958c358ad4eb19f270ee801e3fe41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.114293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59e39c-dd83-448a-97a4-63060598adc8 None admin] RBAC: Authorizing `identity:get_user(user_id=29d958c358ad4eb19f270ee801e3fe41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:59.115700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59e39c-dd83-448a-97a4-63060598adc8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:59.117732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 146/284] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/users/29d958c358ad4eb19f270ee801e3fe41 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:59.126643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:59.221689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb951d30-97c1-485e-ac08-fa3d946a068b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.222011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb951d30-97c1-485e-ac08-fa3d946a068b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.222241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb951d30-97c1-485e-ac08-fa3d946a068b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.223608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 147/285] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:54:59.229092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.229425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.229638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.248821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:59.250035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:59.278625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff5ce-ed31-4cab-8c3d-9d6ff8395560 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:59.340122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:59.346666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:59.347531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.347808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.348080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.352112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:59.353601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:59.360712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 139/286] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:54:59 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:59.361515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:59.392075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 148/287] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:54:59.432995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:59.446658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:59.521429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df37fe-ffc9-461b-bae4-075226705cd6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:59.590792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:59.591695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.591971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.592244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/29d958c358ad4eb19f270ee801e3fe41/roles/687a860c43a542f08981e3e28dd72891` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.598379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad1119d2ddd4192a76bae766e50e3dd, user_id=29d958c358ad4eb19f270ee801e3fe41, role_id=687a860c43a542f08981e3e28dd72891)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:59.599852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:59.619845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988d66-741a-4b77-b697-79e09c2298bb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:59.639201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 140/288] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:54:59 2022] PUT /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/users/29d958c358ad4eb19f270ee801e3fe41/roles/687a860c43a542f08981e3e28dd72891 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:59.661020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:59.661798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.662085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.662410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.678047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:54:59.688935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:54:59.689838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:54:59.691013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 149/289] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:54:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:54:59.696164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:59.818099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:59.862499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4cd2-3900-44c5-9185-d2a08a6e5cde None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:59.903523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:59.904295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:59.904585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:59.904890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:59.905659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:59.905970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:59.908042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:59.917925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 141/290] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:54:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:59.924222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:00.033357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:00.067086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff341-c8ad-4707-90e0-0aefe6fc4a8b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:00.106069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:00.106948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:00.107227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:00.107499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] PATH_INFO: `/v3/users/89149277a2fa43dfaa6ba2415ce9fa6d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:00.108720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] RBAC: Authorizing `identity:get_user(user_id=89149277a2fa43dfaa6ba2415ce9fa6d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:00.110617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:00.112552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 150/291] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:54:59 2022] GET /identity/v3/users/89149277a2fa43dfaa6ba2415ce9fa6d => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:00.117937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:00.264472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab34a-b9d5-4a01-a840-a16f272b936b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:00.294510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:00.311726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:00.312707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:00.313610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:00.313946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:00.393320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:00.394794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:00.526311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 142/292] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:00.532423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:00.646357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59cda9-7d2d-4cb3-aee8-72a38da13548 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:00.684606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39184b-f80c-4666-bb74-35833c91112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:00.685522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39184b-f80c-4666-bb74-35833c91112a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:00.685804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39184b-f80c-4666-bb74-35833c91112a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:00.686080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39184b-f80c-4666-bb74-35833c91112a None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:00.687262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39184b-f80c-4666-bb74-35833c91112a None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:00.689659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39184b-f80c-4666-bb74-35833c91112a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:00.691407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 151/293] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:00 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:00.697170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:00.727351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:00.839178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86109c-e59e-48a5-9175-9b5f3dfcd7e0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:00.880140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:00.880824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:00.881108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:00.881379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:00.882211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=89149277a2fa43dfaa6ba2415ce9fa6d) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:00.882519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:00.883972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff8ec-e93f-4997-b2e2-0253b499e977 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:00.891025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 143/294] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:00 2022] GET /identity/v3/role_assignments?user.id=89149277a2fa43dfaa6ba2415ce9fa6d&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=81e2b7e27546405389402bc4b6987138 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:01.467925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004d09-e5d9-42f9-823c-8d00450cbe98 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.468430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004d09-e5d9-42f9-823c-8d00450cbe98 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.468506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004d09-e5d9-42f9-823c-8d00450cbe98 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.470707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 152/295] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:01.476539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.476855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.477134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.497678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:01.498865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:01.582349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 144/296] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:01.600981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a4d2-5d67-4463-bf1f-6b10e48f8ff7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.601563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a4d2-5d67-4463-bf1f-6b10e48f8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.602071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a4d2-5d67-4463-bf1f-6b10e48f8ff7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.604048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 153/297] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:01.608049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:01.608920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9b009-52d9-43eb-aa49-f238834e475f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.609852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9b009-52d9-43eb-aa49-f238834e475f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.610301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9b009-52d9-43eb-aa49-f238834e475f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.611801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 154/298] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:55:01.613996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c016cc-2793-4fb8-9e8d-b2a5662ba25a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.614206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c016cc-2793-4fb8-9e8d-b2a5662ba25a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.614453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c016cc-2793-4fb8-9e8d-b2a5662ba25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.629211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:01.637171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:01.640459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-43c016cc-2793-4fb8-9e8d-b2a5662ba25a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:01.641857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-43c016cc-2793-4fb8-9e8d-b2a5662ba25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:01.717774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 155/299] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:01.719489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.719726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.719996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.730428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa955-8905-49a4-955f-8afa2ccbc625 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:01.747216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:01.749007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:01.767583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:01.768382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.768666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.768990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.779439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:01.787430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:01.788326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:01.789482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 145/300] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:01.793851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:01.835274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 156/301] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:01.836034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:01.888382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:01.907634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:01.914170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c5884-00f2-48bf-b746-45a19aaff3af None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:01.950231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2a597-69a2-4b3d-89d4-71d67be15a6a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:01.950424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:01.951225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.951504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.951785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.963300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:01.971787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:01.972658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 146/302] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:01.974875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:01.994668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:01.995358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:01.995638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:01.995909 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:01.996644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:01.996977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:01.998415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.007553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 157/303] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:02.008262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.085871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8b42-7fb6-4954-84c4-ced356a5669d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.112217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373638-7c46-4020-8897-1d0701ff57b5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.121450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.122246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.122524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.122790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.123961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.126324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.132344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 147/304] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:02.132344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.134429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:02.143713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:02.152010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.152702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.152992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.153266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.154007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:02.154316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.155681 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.164140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 158/305] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:02.164936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.250398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde64b2-148c-48b0-8aec-fcd80b755791 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.282692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382f98-ced5-4710-8782-b8e4265c87d3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.286105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.286978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.287254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.287523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] PATH_INFO: `/v3/users/b4fc3597a4f54825bb1eab8d784fc92c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.302308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] RBAC: Authorizing `identity:get_user(user_id=b4fc3597a4f54825bb1eab8d784fc92c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.303891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.310166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 148/306] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:55:02 2022] GET /identity/v3/users/b4fc3597a4f54825bb1eab8d784fc92c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:02.310166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.324497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.325240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.325484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.325755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] PATH_INFO: `/v3/groups` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.326431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.328442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.356743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 159/307] 10.222.0.31 () {60 vars in 1134 bytes} [Wed May 25 16:55:02 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:02.356743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.376893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:02.423930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f133-8f91-40cf-aa37-eca54d6da56a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.436670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:02.465315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06b6e1-d3ef-4cc8-94e4-ca0c714df27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.466217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06b6e1-d3ef-4cc8-94e4-ca0c714df27a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.466496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06b6e1-d3ef-4cc8-94e4-ca0c714df27a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.466767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06b6e1-d3ef-4cc8-94e4-ca0c714df27a None admin] PATH_INFO: `/v3/users/ae4fb002c7fd4fd5860bf1174706e209` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.468042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06b6e1-d3ef-4cc8-94e4-ca0c714df27a None admin] RBAC: Authorizing `identity:get_user(user_id=ae4fb002c7fd4fd5860bf1174706e209)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.470702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06b6e1-d3ef-4cc8-94e4-ca0c714df27a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.476475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 149/308] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:55:02 2022] GET /identity/v3/users/ae4fb002c7fd4fd5860bf1174706e209 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:02.476475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472f29-d7fb-460e-a86e-798fca7e3ac5 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.476475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472f29-d7fb-460e-a86e-798fca7e3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.476475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472f29-d7fb-460e-a86e-798fca7e3ac5 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.476475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 150/309] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:02.477678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472f29-d7fb-460e-a86e-798fca7e3ac5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.504658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4a947-cb6d-4c89-a104-6f5b40f8a038 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.547884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.549546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.549546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.549546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.550047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] RBAC: Adding query filter params (role.id=687a860c43a542f08981e3e28dd72891, user.id=b4fc3597a4f54825bb1eab8d784fc92c, scope.system=all) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:02.550366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.551831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d03bc-2180-4555-ab23-0ef96c0bff64 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.558458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 160/310] 10.222.0.31 () {56 vars in 1308 bytes} [Wed May 25 16:55:02 2022] GET /identity/v3/role_assignments?user.id=b4fc3597a4f54825bb1eab8d784fc92c&scope.system=all&role.id=687a860c43a542f08981e3e28dd72891 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:02.559329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.559615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.559884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.581122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:02.583101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:02.610855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472f29-d7fb-460e-a86e-798fca7e3ac5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.653075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:02.661608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.662826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.663133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.663854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] PATH_INFO: `/v3/system/users/ae4fb002c7fd4fd5860bf1174706e209/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.666086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ae4fb002c7fd4fd5860bf1174706e209, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:02.668301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:02.672778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 161/311] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:02.686822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 151/312] 10.222.0.31 () {58 vars in 1334 bytes} [Wed May 25 16:55:02 2022] PUT /identity/v3/system/users/ae4fb002c7fd4fd5860bf1174706e209/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:02.697716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.752979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:02.815997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59847c16-c28b-44bb-8758-be4d96b800a1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:02.853984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:02.854795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:02.855073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:02.855343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:02.868015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:02.876110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:02.877089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:02.878088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 162/313] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:02.883173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:02.997394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12cd8d-04ac-4d27-b72f-e4448a029277 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:03.034118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:03.034843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:03.035135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:03.035412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:03.036170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:03.036479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:03.037903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:03.047090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 152/314] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:03.052379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:03.155538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ad1d0-69e6-4c24-aa7b-c3998786d551 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:03.158811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:03.198459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:03.199356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:03.199643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:03.199917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] PATH_INFO: `/v3/users/29d958c358ad4eb19f270ee801e3fe41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:03.201188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] RBAC: Authorizing `identity:get_user(user_id=29d958c358ad4eb19f270ee801e3fe41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:03.202640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:03.205113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 163/315] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:55:03 2022] GET /identity/v3/users/29d958c358ad4eb19f270ee801e3fe41 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:03.210589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:03.269774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:03.315151 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0565-9db8-4f39-8f25-195125cee171 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:03.350032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:03.350693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:03.350979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:03.351256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:03.421546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:03.423420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:03.481031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:03.526995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 153/316] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:03.532311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:03.643302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9c07-7c6d-4ad7-a408-abc42589111b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:03.678346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b671e1-2d0b-43f9-8bc0-a9edbd6d9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:03.679226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b671e1-2d0b-43f9-8bc0-a9edbd6d9fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:03.679512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b671e1-2d0b-43f9-8bc0-a9edbd6d9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:03.679790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b671e1-2d0b-43f9-8bc0-a9edbd6d9fc8 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:03.681027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b671e1-2d0b-43f9-8bc0-a9edbd6d9fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:03.682478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b671e1-2d0b-43f9-8bc0-a9edbd6d9fc8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:03.684472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 164/317] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:03 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:03.690969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:03.799320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996fe5f-4782-442d-894f-57b1ce4a4d13 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:03.838684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:03.839352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:03.839635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:03.839913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:03.840791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] RBAC: Adding query filter params (role.id=687a860c43a542f08981e3e28dd72891, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd, user.id=29d958c358ad4eb19f270ee801e3fe41) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:03.841107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:03.842572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfadbf-79c3-4f96-b9e0-abf599d36d37 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:03.850313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 154/318] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:03 2022] GET /identity/v3/role_assignments?user.id=29d958c358ad4eb19f270ee801e3fe41&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=687a860c43a542f08981e3e28dd72891 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:04.751632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2dbd-9a90-4538-872f-31e8b1d6da16 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:04.752168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2dbd-9a90-4538-872f-31e8b1d6da16 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:04.752168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2dbd-9a90-4538-872f-31e8b1d6da16 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:04.753620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 165/319] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:04.758774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9af0e-56bc-491a-ac9f-e7669301ed31 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:04.759155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9af0e-56bc-491a-ac9f-e7669301ed31 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:04.759319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9af0e-56bc-491a-ac9f-e7669301ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:04.777069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-96f9af0e-56bc-491a-ac9f-e7669301ed31 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:04.778306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96f9af0e-56bc-491a-ac9f-e7669301ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:04.795645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:04.855104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 155/320] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:04.862762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9f25-cf1d-4499-b696-e5e75d250189 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:04.863042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9f25-cf1d-4499-b696-e5e75d250189 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:04.863321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9f25-cf1d-4499-b696-e5e75d250189 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:04.864922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 166/321] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:04.870133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c356-e4e2-414e-b4b6-56cca1f5e612 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:04.870644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c356-e4e2-414e-b4b6-56cca1f5e612 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:04.871001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c356-e4e2-414e-b4b6-56cca1f5e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:04.881417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9f25-cf1d-4499-b696-e5e75d250189 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:04.890958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2c81c356-e4e2-414e-b4b6-56cca1f5e612 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:04.892743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2c81c356-e4e2-414e-b4b6-56cca1f5e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:04.929606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:04.964000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 156/322] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:04.971828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93518-35a7-4f09-bfb1-56c22eaab30f None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:04.972121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93518-35a7-4f09-bfb1-56c22eaab30f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:04.972405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93518-35a7-4f09-bfb1-56c22eaab30f None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:04.973757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 157/323] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:55:04.978496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:04.978782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:04.979057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:04.994570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9f25-cf1d-4499-b696-e5e75d250189 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:04.996941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:04.998207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:05.027010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.027799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.028081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.028357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.029546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.031479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.033111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 167/324] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:05.033864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.067120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 158/325] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:05.067943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.079063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.136345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791de3a-98f7-44c1-b660-dc4066fb0110 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.144953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.168642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445ed9-c22c-41a5-bdbc-b837d720d968 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.170232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.171016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.171299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.171703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.181984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:05.190053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:05.190922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:05.191701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 168/326] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:05.192347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.207700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.208367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.208646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.208966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] PATH_INFO: `/v3/groups` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.209657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.211093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.225221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 159/327] 10.222.0.31 () {60 vars in 1134 bytes} [Wed May 25 16:55:05 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:05.225961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.305593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666399c4-2b4b-4f71-9d34-16f540823379 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.314156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.353464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.354275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.354556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.354770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a60f22-6c41-4909-831d-f6b26e06a1c5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.354871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.367570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:05.376107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:05.377336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:05.378149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 169/328] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:05.383584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.395222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.395910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.396197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.396472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.397288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:05.397598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.399124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.408704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 160/329] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:05.414516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.422597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.521024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1db0-2c40-4678-aef1-1fb46a04cb9c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.540557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e840ea-153f-4fca-a245-b35ecb5070c0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.565698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.565698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.565998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.566068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.566809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:05.567400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.568501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.579187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 170/330] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:05.583360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.585900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.593307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.594910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.595194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.595470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] PATH_INFO: `/v3/users/b4fc3597a4f54825bb1eab8d784fc92c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.597249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] RBAC: Authorizing `identity:get_user(user_id=b4fc3597a4f54825bb1eab8d784fc92c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.598724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.601792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 161/331] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/users/b4fc3597a4f54825bb1eab8d784fc92c => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:05.607642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.730388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.742317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d833-e3f2-4ae1-a601-7b8ee1a1b7bf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.754640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753a6a6-0492-4063-bb57-003213397e43 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.795755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.796548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.796854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.797128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] PATH_INFO: `/v3/system/users/b4fc3597a4f54825bb1eab8d784fc92c/roles/687a860c43a542f08981e3e28dd72891` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.799387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b4fc3597a4f54825bb1eab8d784fc92c, role_id=687a860c43a542f08981e3e28dd72891)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.801174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.807380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a7554-fbfa-4ca8-9bb3-bde50a482b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.808421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7554-fbfa-4ca8-9bb3-bde50a482b91 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:05.808843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7554-fbfa-4ca8-9bb3-bde50a482b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:05.809211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7554-fbfa-4ca8-9bb3-bde50a482b91 None admin] PATH_INFO: `/v3/users/ae4fb002c7fd4fd5860bf1174706e209` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:05.810659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 162/332] 10.222.0.31 () {58 vars in 1334 bytes} [Wed May 25 16:55:05 2022] PUT /identity/v3/system/users/b4fc3597a4f54825bb1eab8d784fc92c/roles/687a860c43a542f08981e3e28dd72891 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:55:05.816835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a7554-fbfa-4ca8-9bb3-bde50a482b91 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4fb002c7fd4fd5860bf1174706e209)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:05.818886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a7554-fbfa-4ca8-9bb3-bde50a482b91 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:05.821453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 171/333] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/users/ae4fb002c7fd4fd5860bf1174706e209 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:05.828853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:05.914937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:05.958709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eaa46-33b5-409c-a440-124f6780616a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:05.998962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:05.999632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:06.000512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:06.000893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:06.001831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] RBAC: Adding query filter params (role.id=81e2b7e27546405389402bc4b6987138, user.id=ae4fb002c7fd4fd5860bf1174706e209, scope.system=all) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:06.002144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:06.003644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a492-672f-4c44-8cd5-911fbd0a915f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:06.017994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 163/334] 10.222.0.31 () {56 vars in 1308 bytes} [Wed May 25 16:55:05 2022] GET /identity/v3/role_assignments?user.id=ae4fb002c7fd4fd5860bf1174706e209&scope.system=all&role.id=81e2b7e27546405389402bc4b6987138 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:08.157834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae7de0-f1e4-4e78-8012-c2eef2bb8668 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.158434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae7de0-f1e4-4e78-8012-c2eef2bb8668 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.158434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae7de0-f1e4-4e78-8012-c2eef2bb8668 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.159991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 172/335] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:08.166064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.166560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.166643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.183773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:08.185008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:08.194432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1a66-a442-4ea7-9f3e-b27ee80103a1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.194432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1a66-a442-4ea7-9f3e-b27ee80103a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.194432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1a66-a442-4ea7-9f3e-b27ee80103a1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.195134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 173/336] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:55:08.200389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.200960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.201445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.220415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:08.221950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:08.262661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 164/337] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:08.289209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:08.301770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 174/338] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:08.327425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:08.348242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:08.414068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b2c5-bb3e-421b-be14-2a8b35858445 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:08.434639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:08.448362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138a99a-5b0f-4fad-b56e-b59da59a4de8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:08.457713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:08.458519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.458797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.459066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.470192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:08.479398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:08.480335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:08.485614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 165/339] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:08.487188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:08.509415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:08.510619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.511114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.511591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.525976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:08.538772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:08.539711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:08.540504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:08.543398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 175/340] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:08.550282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:08.612918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046c06b-9776-4a69-a999-1d357a285ec0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:08.633124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:08.649186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:08.650141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.650445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.650727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.651492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:08.651806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:08.653938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:08.664425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 166/341] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:08.670810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:08.771049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a4085-6c4b-4413-9dbc-a512193d674f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:08.791837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7c4c-0d44-43a5-a8d0-12afe4bef9b8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:08.826746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:08.827867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.828381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.828890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.829869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:08.831163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:08.831702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:08.831822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:08.832109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:08.832388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:08.833823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:08.852234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 176/342] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:08.857925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:08.876711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:08.881209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:08.912700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:08.912700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:09.006251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab9ca8-383a-4e53-9449-f80db916e4a7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.022332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 167/343] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:55:09.028135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.066300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f027d-3968-44ee-914f-3f4bd12e5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.067327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f027d-3968-44ee-914f-3f4bd12e5646 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.067826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f027d-3968-44ee-914f-3f4bd12e5646 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.068307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f027d-3968-44ee-914f-3f4bd12e5646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.140055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fbc76-bfbc-4ad7-9f88-8eeb295e847f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.152700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:09.159979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f027d-3968-44ee-914f-3f4bd12e5646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:09.162063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f027d-3968-44ee-914f-3f4bd12e5646 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:09.180994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:09.181667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.182637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.182882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.188700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.188700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:09.188700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:09.190215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 168/344] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:09.197104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.310615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52347b-06ce-471e-a6ca-c0eb8650417a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.347213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 177/345] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:55:09.348853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd671d7f-2b03-4e81-8d10-22eb08c390b9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.349330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd671d7f-2b03-4e81-8d10-22eb08c390b9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.349431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811172-90ce-476a-b33a-ae66a1ed4d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.349891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd671d7f-2b03-4e81-8d10-22eb08c390b9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.350457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811172-90ce-476a-b33a-ae66a1ed4d17 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.350960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811172-90ce-476a-b33a-ae66a1ed4d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.351428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811172-90ce-476a-b33a-ae66a1ed4d17 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.351540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 178/346] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:09.357183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd671d7f-2b03-4e81-8d10-22eb08c390b9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.359371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811172-90ce-476a-b33a-ae66a1ed4d17 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:09.361114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811172-90ce-476a-b33a-ae66a1ed4d17 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:09.363507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 169/347] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:09.364968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.370858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.371432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.389067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:09.397165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:09.401436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:09.487594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd671d7f-2b03-4e81-8d10-22eb08c390b9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.499128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:09.511549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 170/348] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:09.512770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.533293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389618-e261-4163-9164-0863e93265db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.534175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389618-e261-4163-9164-0863e93265db None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.534452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389618-e261-4163-9164-0863e93265db None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.534722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389618-e261-4163-9164-0863e93265db None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.537354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389618-e261-4163-9164-0863e93265db None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:09.538852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389618-e261-4163-9164-0863e93265db None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:09.544603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 179/349] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:09.551948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389618-e261-4163-9164-0863e93265db None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.679406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233a4a3-641f-4dbd-98f7-fc03ee8faf77 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.711482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389618-e261-4163-9164-0863e93265db None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.722916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.723831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.724370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.724851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.725862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:09.726330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:09.728182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:09.731647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:09.736312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 171/350] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=81e2b7e27546405389402bc4b6987138 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:09.737573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.749860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb24b7-9c0a-4c10-81cb-5060ee15e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.750489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb24b7-9c0a-4c10-81cb-5060ee15e748 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.750772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb24b7-9c0a-4c10-81cb-5060ee15e748 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.751051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb24b7-9c0a-4c10-81cb-5060ee15e748 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.774420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb24b7-9c0a-4c10-81cb-5060ee15e748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-69fb24b7-9c0a-4c10-81cb-5060ee15e748 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:09.784731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:09.785714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:09.786524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 180/351] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:09.793747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09fd9d-5b86-4d5f-957a-f2a5c569392d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.794060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09fd9d-5b86-4d5f-957a-f2a5c569392d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.794300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09fd9d-5b86-4d5f-957a-f2a5c569392d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:09.795729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 181/352] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:09.799419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09fd9d-5b86-4d5f-957a-f2a5c569392d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:09.900702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:09.942797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1320a-a017-4872-8af4-9e2955c539bb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:09.992161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030efb23-d471-4e9f-9937-a197787c1677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:09.993156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030efb23-d471-4e9f-9937-a197787c1677 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:09.993442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030efb23-d471-4e9f-9937-a197787c1677 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:09.993718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030efb23-d471-4e9f-9937-a197787c1677 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.000706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030efb23-d471-4e9f-9937-a197787c1677 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:10.000706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030efb23-d471-4e9f-9937-a197787c1677 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:10.002202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 172/353] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:10.005790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.007171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.007466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.026365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:10.027571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:10.052828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09fd9d-5b86-4d5f-957a-f2a5c569392d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:10.099097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:10.100371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.100899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.101600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.102576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:10.103503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:10.105107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:10.117232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 182/354] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:10.118386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.119137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:10.126628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 173/355] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:10.127567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.309296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f856d-d447-479f-bf92-f3187fb8b664 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:10.315930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:10.324134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247e634-c897-4b32-852c-f5e285dc2cf5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:10.385264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:10.386153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.386432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] PATH_INFO: `/v3/users/b4fc3597a4f54825bb1eab8d784fc92c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.387851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:10.388496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.388802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.389072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.389903 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:10.390284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:10.391731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6315c34-9ace-40e8-b257-f4deba525d90 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:10.393535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] RBAC: Authorizing `identity:get_user(user_id=b4fc3597a4f54825bb1eab8d784fc92c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:10.394981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:10.397017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 174/356] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/users/b4fc3597a4f54825bb1eab8d784fc92c => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:10.397858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.402662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 183/357] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=f9187cfd078c4241b44e62a19296c815 => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:10.405373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646af7d-d021-42c6-b323-a8295906c1a0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.405655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646af7d-d021-42c6-b323-a8295906c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.406533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646af7d-d021-42c6-b323-a8295906c1a0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.407982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 184/358] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:10.413364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646af7d-d021-42c6-b323-a8295906c1a0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.518880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:10.561856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7202c-7957-4668-8129-dc51d59510ac None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:10.572848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646af7d-d021-42c6-b323-a8295906c1a0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:10.608292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5294cca-4a22-4725-a660-759f6e3a827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:10.611202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5294cca-4a22-4725-a660-759f6e3a827b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.611653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5294cca-4a22-4725-a660-759f6e3a827b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.612187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5294cca-4a22-4725-a660-759f6e3a827b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.614486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:10.615307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.615687 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.616113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.617241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] RBAC: Adding query filter params (role.id=687a860c43a542f08981e3e28dd72891, user.id=b4fc3597a4f54825bb1eab8d784fc92c, scope.system=all) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:10.617663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:10.619267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe573-e09d-48e1-bfed-d9d2c7960278 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:10.627095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5294cca-4a22-4725-a660-759f6e3a827b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:10.634036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 185/359] 10.222.0.31 () {56 vars in 1308 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/role_assignments?user.id=b4fc3597a4f54825bb1eab8d784fc92c&scope.system=all&role.id=687a860c43a542f08981e3e28dd72891 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:10.635366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.635804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a5294cca-4a22-4725-a660-759f6e3a827b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:10.635955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:10.637013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:10.637918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:10.638514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.640882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 175/360] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:10.642692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b53c-8284-44d3-a8ba-cb0dd433b747 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.643170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b53c-8284-44d3-a8ba-cb0dd433b747 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.643731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b53c-8284-44d3-a8ba-cb0dd433b747 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.645285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 176/361] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:10.654201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.654786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.655251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.662648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:10.663877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:10.707145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:10.708358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:10.733110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:10.795964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 186/362] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:10.797622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.896024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 177/363] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:10.896869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.925723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ceecd-ecfb-46fe-9b36-3875370e940a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:10.965036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:10.965710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:10.965992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:10.966266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:10.967009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:10.967314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:10.969282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:10.979977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 187/364] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:10.982457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:10.997049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.004410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.041034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312b138-6dab-42ca-9738-08bfc894057c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.080432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.081533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.082292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.082581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.097124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:11.105521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:11.106420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:11.107207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 178/365] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:11.107870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.107942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975501-4151-4063-b84e-915b6f573b7f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.149941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.150686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.150967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.151241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.167228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:11.178968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:11.179896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:11.180735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:11.184806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 188/366] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:11.185683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.244501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221440-9b7f-43e1-81ba-e96b7dd9563d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.264584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.285265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.285923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.286207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.286636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.299671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.338718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be7f8-dd68-4564-afe3-b1afc4a38eaa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.379724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.380401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.380935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.381211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.382494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:11.382801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:11.383905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:11.384475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:11.385444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:11.396277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 189/367] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:11.397529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.530028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 179/368] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:11.531553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.534968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113a45-702e-4cf4-87ff-e0ff74f497e2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.563633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.581718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.582713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.583406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.584814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.585775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:11.586290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:11.587918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:11.597080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.602921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 190/369] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:11.602921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.683136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a087-6415-4bc5-b0fd-871e46d828bc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.731311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.731969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.732248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.732520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.747013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b0f06-4940-407c-812c-27f933c6dc31 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.789098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.790332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.790813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.791280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:11.792656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:11.794344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:11.796229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 191/370] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:11.798698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.813724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:11.815530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:11.836310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.875940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:11.922587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cce4ca-8939-4579-b0b7-3bd4f5145d48 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:11.929393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 180/371] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:11.930436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:11.961244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:11.962265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:11.962748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:11.963167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.040900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.042714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.044963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808af9a1-a72c-4d71-b858-781a53ba0500 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.063669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:12.092602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.093784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.094212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.094681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.096863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.098494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.100279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 181/372] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:12.101209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.121143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:12.160574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 192/373] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:12.161807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.209332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3300c-c89e-42b7-ba7b-e35e9a3f410d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.245705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.246835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.247275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.247688 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] PATH_INFO: `/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.249071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e51ce5f84b498ea59e7bf6bab45356)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.251394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.253298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 182/374] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:12.254300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.275727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23bd3-d929-4fe0-a324-131a4f594293 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.318283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:12.319844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.320821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.321675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.321675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.322649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:12.323104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.324767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.333256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 193/375] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=81e2b7e27546405389402bc4b6987138 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:12.334368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.373151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:12.376318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68305887-4ea1-462a-a3c1-3d414b62d7e2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.419735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.420792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.421364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.422361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.426125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.427897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.429918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 183/376] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:12.435960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.466532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7460a-a783-440e-972e-731cb7398752 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.513788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.515148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.516495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.517018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] PATH_INFO: `/v3/groups/4e72008db1284a34bdb30c9e53135b80` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.526262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] RBAC: Authorizing `identity:get_group(group_id=4e72008db1284a34bdb30c9e53135b80)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.528465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.533250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 194/377] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/groups/4e72008db1284a34bdb30c9e53135b80 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:12.544118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.611255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067a203-6bde-43fb-9ac3-bd22992338dc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.647770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:12.673461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06f302-d689-472f-9139-ddfbead9e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.674625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06f302-d689-472f-9139-ddfbead9e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06f302-d689-472f-9139-ddfbead9e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.675501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06f302-d689-472f-9139-ddfbead9e2f6 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.677542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06f302-d689-472f-9139-ddfbead9e2f6 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.679336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06f302-d689-472f-9139-ddfbead9e2f6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.681649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 184/378] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:12.683887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da3a21-2337-4d57-964b-91bd6ca5a580 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.685112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da3a21-2337-4d57-964b-91bd6ca5a580 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.685891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:12.689059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da3a21-2337-4d57-964b-91bd6ca5a580 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.692177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 185/379] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:12.692292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da3a21-2337-4d57-964b-91bd6ca5a580 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.699297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b8a35-aa9c-411e-8dfc-c26490e172f0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:12.747108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:12.747776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.748063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.748343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.749220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] RBAC: Adding query filter params (group.id=4e72008db1284a34bdb30c9e53135b80, role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=a1e51ce5f84b498ea59e7bf6bab45356) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:12.749601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:12.752005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b8a7-c880-4e4d-8249-7bbbccc6845f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:12.759312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 195/380] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/role_assignments?group.id=4e72008db1284a34bdb30c9e53135b80&scope.project.id=a1e51ce5f84b498ea59e7bf6bab45356&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:12.764381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:12.764381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:12.764381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:12.781988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:12.783502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:12.869643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 196/381] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:12.898826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:12.923132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da3a21-2337-4d57-964b-91bd6ca5a580 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.007471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.008155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.008440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.008747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.009684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:13.010006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:13.011787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:13.021560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 186/382] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=f9187cfd078c4241b44e62a19296c815 => generated 260 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:13.049128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:13.067235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080c192-cc25-4d25-b07c-205c176c43fe None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.107425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbcb7c-5dce-437a-803b-6a7b4fce184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.108316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbcb7c-5dce-437a-803b-6a7b4fce184d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.108605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbcb7c-5dce-437a-803b-6a7b4fce184d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.109517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbcb7c-5dce-437a-803b-6a7b4fce184d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.122205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbcb7c-5dce-437a-803b-6a7b4fce184d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c2cbcb7c-5dce-437a-803b-6a7b4fce184d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:13.130869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:13.131812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:13.132612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 197/383] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:13.141933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.224622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:13.241387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd286c-9693-4094-b7c8-dc7a8841db29 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.241712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd286c-9693-4094-b7c8-dc7a8841db29 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.241954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd286c-9693-4094-b7c8-dc7a8841db29 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.243346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 198/384] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:13.249186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.249532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.250452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.270470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:13.271668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:13.291185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3a01f-4859-4c05-a77c-35f766691424 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.331724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.332578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.333468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.333868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.334730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] RBAC: Adding query filter params (name=member) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:13.335244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:13.336788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:13.352801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 187/385] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:13.353260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.364762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 199/386] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:13.385728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.469686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b47c-0184-42f4-976e-1f5ae9708ccf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.485294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:13.517065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:13.520713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.521998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.522473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.522896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.524380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:13.526114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:13.528335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 188/387] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:13 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:13.534157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.541484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61cf8-be9e-4c16-a6ad-bf2a52ddb8db None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.580049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.581188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.581635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.582050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.593707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:13.602237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:13.603358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:13.604341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:13.606980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 200/388] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:13.613376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.657859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f206ff-48a5-4c6e-97d0-3a35e26b1969 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.704837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.706105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.706553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.706978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.708365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:13.710073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:13.712263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 189/389] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:13 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:13.718064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.747888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90908405-3f6c-4327-b7c7-34e63544a315 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.786564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:13.791736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.792628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.793135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.793551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.794450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:13.794902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:13.797299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:13.803563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:13.808382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 201/390] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:13.817981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:13.878942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb9d8a-7ad7-46cd-9196-bd17c5b5e63c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.937542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c14cc-bc05-45ed-a34d-1cb63c3f4c9e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:13.954780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.955946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.956232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.956515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/groups/71ac0c560b69407da51caf05229029d8/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:13.959366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc419f19cc24b04ac728d5de53b8a4b, group_id=71ac0c560b69407da51caf05229029d8, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:13.961497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:13.983448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 190/391] 10.222.0.31 () {58 vars in 1442 bytes} [Wed May 25 16:55:13 2022] PUT /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/groups/71ac0c560b69407da51caf05229029d8/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:13.995164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:13.996114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:13.996443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:13.996746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:14.001412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:14.002877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:14.004827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 202/392] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:13 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:14.010828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:14.156744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d41de8-71a3-4cd4-abcc-cea8878d6d89 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:14.168282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:14.202345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10babe73-ec7f-45f2-868d-6af44a2a916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:14.203924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10babe73-ec7f-45f2-868d-6af44a2a916a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:14.204214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10babe73-ec7f-45f2-868d-6af44a2a916a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:14.204496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10babe73-ec7f-45f2-868d-6af44a2a916a None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:14.205749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10babe73-ec7f-45f2-868d-6af44a2a916a None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:14.207209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10babe73-ec7f-45f2-868d-6af44a2a916a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:14.213191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 191/393] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:14 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:14.219419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:14.307933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:14.350762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c4b5-634d-4374-85a4-95559bb65bd6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:14.390205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09ec03-e247-4fe6-a704-db95ed1ad878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:14.391912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09ec03-e247-4fe6-a704-db95ed1ad878 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:14.392389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09ec03-e247-4fe6-a704-db95ed1ad878 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:14.392988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09ec03-e247-4fe6-a704-db95ed1ad878 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/groups/71ac0c560b69407da51caf05229029d8/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:14.395481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09ec03-e247-4fe6-a704-db95ed1ad878 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc419f19cc24b04ac728d5de53b8a4b, group_id=71ac0c560b69407da51caf05229029d8, role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:14.397153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09ec03-e247-4fe6-a704-db95ed1ad878 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:14.416822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 203/394] 10.222.0.31 () {58 vars in 1442 bytes} [Wed May 25 16:55:14 2022] PUT /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b/groups/71ac0c560b69407da51caf05229029d8/roles/f9187cfd078c4241b44e62a19296c815 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:15.523784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440b03-80da-41a7-a6a8-9d76bbc7b786 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:15.524288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440b03-80da-41a7-a6a8-9d76bbc7b786 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:15.524578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440b03-80da-41a7-a6a8-9d76bbc7b786 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:15.526113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 192/395] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:15.531954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:15.532784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:15.533198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:15.557761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:15.559184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:15.640942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 204/396] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:15.671822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440b03-80da-41a7-a6a8-9d76bbc7b786 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:15.806786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440b03-80da-41a7-a6a8-9d76bbc7b786 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:15.847934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7a216-04be-4eeb-a4c4-150195f1c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:15.848793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7a216-04be-4eeb-a4c4-150195f1c12c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:15.849076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7a216-04be-4eeb-a4c4-150195f1c12c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:15.849358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7a216-04be-4eeb-a4c4-150195f1c12c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:15.861351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7a216-04be-4eeb-a4c4-150195f1c12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-25f7a216-04be-4eeb-a4c4-150195f1c12c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:15.869511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:15.870387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:15.871583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 193/397] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:15.877548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:15.924410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454290-c013-4a6e-99a0-f47d89c01be8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:15.924946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454290-c013-4a6e-99a0-f47d89c01be8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:15.925440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c454290-c013-4a6e-99a0-f47d89c01be8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:15.927428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 194/398] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:15.932360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:15.932999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:15.933479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:15.943158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:15.960526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:15.962204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:15.992105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff1e7e-dd3e-499f-8e30-62f199c37799 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:15.997392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.033496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.034446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.034893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.035315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.036265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:16.036740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:16.038322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:16.042725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 195/399] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:16.050493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 205/400] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:16.056250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.086116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.191266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72dec2-c6dd-403c-a013-a159e8db32db None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.201869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2812e3-ea14-4df3-87e8-350366e20113 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.223497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.232924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7ac25-0e64-404e-ab81-0e02ccdcf214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.234099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7ac25-0e64-404e-ab81-0e02ccdcf214 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.234502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7ac25-0e64-404e-ab81-0e02ccdcf214 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.235079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7ac25-0e64-404e-ab81-0e02ccdcf214 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.236277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7ac25-0e64-404e-ab81-0e02ccdcf214 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:16.237873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7ac25-0e64-404e-ab81-0e02ccdcf214 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:16.240781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 196/401] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:16.241441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11a23-aa6e-408e-bdff-1903586fa071 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.241915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11a23-aa6e-408e-bdff-1903586fa071 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.242400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11a23-aa6e-408e-bdff-1903586fa071 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.243782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 197/402] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:16.245569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.245569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.245855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.246080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.254467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.255003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.255473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.262649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:16.273153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:16.274051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:16.274843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 206/403] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:16.275546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.277646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:16.279372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:16.312578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.357745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 198/404] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:16.359471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.383517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107ae2e-8e62-48f2-ac64-cc554fa92383 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.420463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.422041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.422447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.422737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.423987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:16.425469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:16.427491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 207/405] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:16.428324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.480061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a1b56-0461-41b7-899e-79998e8746e4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.481538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.521446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.522519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.523004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.523469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.524491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:16.525510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:16.527280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:16.536993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335cd86-1f80-4b21-a46b-5d1b63fa04c9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.538078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 199/406] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:16.539144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.570465 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.575358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.576160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.576454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.576812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.590576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:16.599317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:16.600184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:16.601022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 208/407] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:16.602137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.658206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1952-7b1d-4ea1-a101-e6e28f80caa1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.697499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.698674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.699212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.699679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/groups/71ac0c560b69407da51caf05229029d8/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.702007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad1119d2ddd4192a76bae766e50e3dd, group_id=71ac0c560b69407da51caf05229029d8, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:16.704052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:16.721609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 200/408] 10.222.0.31 () {58 vars in 1442 bytes} [Wed May 25 16:55:16 2022] PUT /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/groups/71ac0c560b69407da51caf05229029d8/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:16.727228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d64c-d9d2-4167-abee-771493851381 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:16.728644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.746415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.767209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:16.768344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:16.768559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:16.768948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:16.770275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:16.776702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:16.776702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 209/409] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:16.783750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:16.933893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:16.953471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e19ae-50f2-44bc-8eeb-b1992cad0aa6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.000094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0896-058d-4b44-89f2-62047b1949fc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.001302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.002216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.002700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.003176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.004414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:17.004946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.006529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.017318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 201/410] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:17.022483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.037099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.038034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.038321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.038655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.039998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.041529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.043816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 210/411] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:16 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:17.051850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.107237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.165076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcbb99-2d39-4a41-ada4-2132d745ee7b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.177308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1ccbd-4600-4f51-b253-d19525bed00c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.203276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57cad1-4114-4791-90ec-f0d61c699b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.204114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cad1-4114-4791-90ec-f0d61c699b6e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.204318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cad1-4114-4791-90ec-f0d61c699b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.204609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cad1-4114-4791-90ec-f0d61c699b6e None admin] PATH_INFO: `/v3/groups/4e72008db1284a34bdb30c9e53135b80` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.205843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57cad1-4114-4791-90ec-f0d61c699b6e None admin] RBAC: Authorizing `identity:get_group(group_id=4e72008db1284a34bdb30c9e53135b80)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.207310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57cad1-4114-4791-90ec-f0d61c699b6e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.209273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 202/412] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/groups/4e72008db1284a34bdb30c9e53135b80 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:17.210556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6dbd-ecd0-4c70-a1fc-5e19c27442d4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.210840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6dbd-ecd0-4c70-a1fc-5e19c27442d4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.211114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6dbd-ecd0-4c70-a1fc-5e19c27442d4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.215411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.216388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.216565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 203/413] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:17.216762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.217028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/groups/71ac0c560b69407da51caf05229029d8/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.217789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.218748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.219427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.220350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad1119d2ddd4192a76bae766e50e3dd, group_id=71ac0c560b69407da51caf05229029d8, role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.221954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.236192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:17.237431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 211/414] 10.222.0.31 () {58 vars in 1442 bytes} [Wed May 25 16:55:17 2022] PUT /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd/groups/71ac0c560b69407da51caf05229029d8/roles/f9187cfd078c4241b44e62a19296c815 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:17.237544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:17.238344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.252962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.313455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 204/415] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:17.337750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.362803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a3825-e3c4-476d-95a3-5fd31ed9c9ca None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.377219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.406601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f00bf-8ae7-4d59-8cc6-699df77b0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.407937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f00bf-8ae7-4d59-8cc6-699df77b0aad None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.408659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f00bf-8ae7-4d59-8cc6-699df77b0aad None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.409137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f00bf-8ae7-4d59-8cc6-699df77b0aad None admin] PATH_INFO: `/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.411133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f00bf-8ae7-4d59-8cc6-699df77b0aad None admin] RBAC: Authorizing `identity:get_project(project_id=a1e51ce5f84b498ea59e7bf6bab45356)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.413029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f00bf-8ae7-4d59-8cc6-699df77b0aad None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.415275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 212/416] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:17.416920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde19e-2699-47ad-9ce3-cea9d8189474 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.417413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde19e-2699-47ad-9ce3-cea9d8189474 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.417832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde19e-2699-47ad-9ce3-cea9d8189474 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.419356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 213/417] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:17.427266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.428515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.428985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.454136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:17.454990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd86e-e035-406e-9030-6652cefb8cda None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.455836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:17.499243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.500609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.500928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.501207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.512030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:17.520138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:17.521252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 205/418] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:17.522338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.538519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.557886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 214/419] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:17.557886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.654722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9464e-da83-4fd1-a55d-8ca4e0d8cb00 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.692396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.693542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.693997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.694419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] PATH_INFO: `/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356/groups/4e72008db1284a34bdb30c9e53135b80/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.696589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e51ce5f84b498ea59e7bf6bab45356, group_id=4e72008db1284a34bdb30c9e53135b80, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.698241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.699559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68fd80-0d45-4245-9787-f779ce220a55 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.701269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.714536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 206/420] 10.222.0.31 () {58 vars in 1442 bytes} [Wed May 25 16:55:17 2022] PUT /identity/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356/groups/4e72008db1284a34bdb30c9e53135b80/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:17.715625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.805153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.809472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.810159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.810438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.810716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.811478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:17.812881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:17.813998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:17.834802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 215/421] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:17.839119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76277-785b-4791-8ec1-4ff18480fda5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:17.845790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:17.903172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:17.904356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:17.904814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:17.905094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:17.933362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:17.942382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:17.943302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:17.944061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 207/422] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:17.950047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.018729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01235fcf-b8bc-4ee2-946e-e2a67deb50ff None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.072528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a276-6ce7-4890-98a1-49a296aaadbe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.073407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.074340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.074863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.075277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.104387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:18.113139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.114703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.114703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.114703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.115164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:18.115478 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.117426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.128053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 208/423] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:18.133379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.135287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:18.209196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.210877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.252407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb04ad-c17e-4496-a361-52195f59255b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.291299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.292042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.292475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.292854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.393461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 216/424] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:18.398646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.411763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:18.445762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.447247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.489496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:18.560091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3b918-0894-480e-9c47-c68334298455 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.616807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 209/425] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:55:18.618286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.644385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.645675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.647147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.647733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.650773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.653620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.656378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 217/426] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:18.661803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.765969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:18.777286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c9c5-11d1-492d-802c-29983c20c9c1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.826442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.827242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.827682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.827967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] PATH_INFO: `/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.832615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] RBAC: Authorizing `identity:get_project(project_id=7dc419f19cc24b04ac728d5de53b8a4b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.832615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.832615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 210/427] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/projects/7dc419f19cc24b04ac728d5de53b8a4b => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:18.840214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.863110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa7df-089a-4a02-a072-b8050ce45b90 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.933052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:18.949943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.950816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.951103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.951377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.957451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.958867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.964701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 218/428] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:18.977457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.985276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885f240-e3c7-499b-9504-ce53d1956c8f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:19.021767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:19.022867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.023322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.023741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.025083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:19.030045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:19.035580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 211/429] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:19.042728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:19.122483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:19.123684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004977-3258-4c3b-8a21-d310d06a0c38 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:19.165165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:19.166634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.167256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.167732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.168821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:19.169332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:19.170986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6aec8-928b-4baf-a4f2-580be8706cce None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:19.179304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 219/430] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=81e2b7e27546405389402bc4b6987138 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:19.292580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5af53c-6de9-4642-81ae-cce86f435287 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:19.351337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:19.352021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.352306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.352583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.353471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:19.353788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:19.355272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b766fc-f6a4-4a19-a5da-11fe7cc3f4ea None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:19.365976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 212/431] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:19 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=7dc419f19cc24b04ac728d5de53b8a4b&role.id=f9187cfd078c4241b44e62a19296c815 => generated 611 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:19.618809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2362-74d0-4272-8390-5e90a642070d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.619331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2362-74d0-4272-8390-5e90a642070d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.619331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2362-74d0-4272-8390-5e90a642070d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.620987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 220/432] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:19.626874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babca105-9231-43f0-affc-ae2e57a7b580 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.627332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babca105-9231-43f0-affc-ae2e57a7b580 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.627408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babca105-9231-43f0-affc-ae2e57a7b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.647702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-babca105-9231-43f0-affc-ae2e57a7b580 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:19.648954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-babca105-9231-43f0-affc-ae2e57a7b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:19.732029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 213/433] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:19.739963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bd55c-6488-40da-ad31-945cf4c7b5bd None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.740246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bd55c-6488-40da-ad31-945cf4c7b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.740517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bd55c-6488-40da-ad31-945cf4c7b5bd None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.742138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 221/434] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:19.747362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.747655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.747934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.760143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bd55c-6488-40da-ad31-945cf4c7b5bd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:19.768541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:19.769756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:19.787849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:19.855187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:19.860388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 214/435] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:19.883300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:19.899111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bd55c-6488-40da-ad31-945cf4c7b5bd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:19.939645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:19.940814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:19.941096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:19.941367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:19.953283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:19.961460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:19.962328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:19.963231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 222/436] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:19.970799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.007087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cd3e2-4954-4c7a-90d1-3453915ff895 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.048020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.048876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.049170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.050354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.060446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:20.069859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:20.070778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:20.072027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 215/437] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:20.077084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.094987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.103335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0806e7-485e-4f84-87a6-972b84b789c2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.132853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.148636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.149732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.150188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.150896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.151840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:20.152317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.154281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.165478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 223/438] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:55:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:20.170994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.204762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a2a62-a432-4929-b7bd-03a4abe7368c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.244432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.245133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.245419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.245700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.246452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:20.246762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.248147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.257447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 216/439] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:20.262611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.284215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ceeb5-cc87-4df1-8784-a65f4ffe0768 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.324014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70c04c-c985-4230-9d77-62c21c9ed9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.324803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c04c-c985-4230-9d77-62c21c9ed9df None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.325157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c04c-c985-4230-9d77-62c21c9ed9df None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.325440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c04c-c985-4230-9d77-62c21c9ed9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.347189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.378731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c612bf8-7ac0-4a8c-a624-96924caf31bd None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.386847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.402905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70c04c-c985-4230-9d77-62c21c9ed9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.404432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70c04c-c985-4230-9d77-62c21c9ed9df None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.416186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558c594-5893-4f5a-bb24-bb3badc56c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.416871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558c594-5893-4f5a-bb24-bb3badc56c58 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.417149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558c594-5893-4f5a-bb24-bb3badc56c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.417424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558c594-5893-4f5a-bb24-bb3badc56c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.487979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558c594-5893-4f5a-bb24-bb3badc56c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.489473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558c594-5893-4f5a-bb24-bb3badc56c58 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.510593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 224/440] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:20.511985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d7b3-29a7-41a0-9576-9b4a398c8dc5 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.512280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d7b3-29a7-41a0-9576-9b4a398c8dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.512557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d7b3-29a7-41a0-9576-9b4a398c8dc5 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.513840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 225/441] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:20.517097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d7b3-29a7-41a0-9576-9b4a398c8dc5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.558424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.592117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 217/442] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:55:20.594620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.594912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.595191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.610255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.615359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:20.616436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:20.627509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d7b3-29a7-41a0-9576-9b4a398c8dc5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.662022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.662795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.663077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.663353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.664533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.665998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.667668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 226/443] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:20.668416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.692471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 218/444] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:20.693187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.770815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669bf6-48c5-4397-ac33-331053372e89 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.800225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5daa-7e83-4d23-9b41-8f03c8152991 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.801734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.803998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.804938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.805242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.805526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] PATH_INFO: `/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.806749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad1119d2ddd4192a76bae766e50e3dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.808198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.809926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 227/445] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/projects/1ad1119d2ddd4192a76bae766e50e3dd => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:20.810679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.839162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:20.840110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.841289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.841507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.841788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.843182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.844632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.846272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 219/446] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:20.846272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.914783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481841-9288-465d-b5fd-d0cd396e5321 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.945907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb399a-cd97-473a-85a8-dd5b9452040b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:20.949357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.950146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.950429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.950702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.961553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:20.970666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:20.971565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:20.972341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:20.972968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 228/447] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:20.974165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:20.986944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:20.987806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:20.988086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:20.988364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] PATH_INFO: `/v3/groups/71ac0c560b69407da51caf05229029d8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:20.989566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] RBAC: Authorizing `identity:get_group(group_id=71ac0c560b69407da51caf05229029d8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:20.991005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:20.998013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 220/448] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/groups/71ac0c560b69407da51caf05229029d8 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:20.998013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:21.036040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:21.059723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:21.078526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259c585-6203-44d1-9f68-7eb289235aaf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.098172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0990-60c6-4d91-b393-c2635dfb4a99 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.111446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.112089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.112370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.112641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.113489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=81e2b7e27546405389402bc4b6987138, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:21.113796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.115231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.120987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 229/449] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=81e2b7e27546405389402bc4b6987138 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:21.121762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:21.133477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.134172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.134457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.134735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.135514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:21.135808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.137306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.146860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 221/450] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:21.152423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:21.250694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ab62-e6bb-4ab9-a918-0bc2a88ef148 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.263899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:21.267640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc049-3bb2-4bda-87c3-9798b70e3ba2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.290371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.291045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.291337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.291617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.292461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] RBAC: Adding query filter params (group.id=71ac0c560b69407da51caf05229029d8, role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:21.292902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.294369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.305236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.305907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.306194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.306474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.311806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 230/451] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:21 2022] GET /identity/v3/role_assignments?group.id=71ac0c560b69407da51caf05229029d8&scope.project.id=1ad1119d2ddd4192a76bae766e50e3dd&role.id=f9187cfd078c4241b44e62a19296c815 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:21.395893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.397427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.512418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:21.520721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 222/452] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:55:21.522135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:21.536709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:21.630805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f1826-9a20-43c9-9852-e9a7fc646f89 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.666309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.667191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.667480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.667753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] PATH_INFO: `/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.668953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e51ce5f84b498ea59e7bf6bab45356)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.670488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.673501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 231/453] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:55:21 2022] GET /identity/v3/projects/a1e51ce5f84b498ea59e7bf6bab45356 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:21.678959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:21.784074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9f4e-5c5d-4f89-9b1c-0a27026845f5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.816503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4536c9d-d114-4e99-b309-752f501e9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.817389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4536c9d-d114-4e99-b309-752f501e9efb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.817671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4536c9d-d114-4e99-b309-752f501e9efb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.817944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4536c9d-d114-4e99-b309-752f501e9efb None admin] PATH_INFO: `/v3/groups/4e72008db1284a34bdb30c9e53135b80` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.819089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4536c9d-d114-4e99-b309-752f501e9efb None admin] RBAC: Authorizing `identity:get_group(group_id=4e72008db1284a34bdb30c9e53135b80)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.820530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4536c9d-d114-4e99-b309-752f501e9efb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.822144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 223/454] 10.222.0.31 () {56 vars in 1180 bytes} [Wed May 25 16:55:21 2022] GET /identity/v3/groups/4e72008db1284a34bdb30c9e53135b80 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:21.828667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:21.903764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:21.925087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed67987-f546-4d50-84e6-c2d266ec2375 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:21.957369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:21.958002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:21.958282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:21.958554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:21.959363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] RBAC: Adding query filter params (group.id=4e72008db1284a34bdb30c9e53135b80, role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=a1e51ce5f84b498ea59e7bf6bab45356) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:21.959674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:21.961124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3124-e75d-4b6d-bbb9-ed323d8af08f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:21.966683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 232/455] 10.222.0.31 () {56 vars in 1376 bytes} [Wed May 25 16:55:21 2022] GET /identity/v3/role_assignments?group.id=4e72008db1284a34bdb30c9e53135b80&scope.project.id=a1e51ce5f84b498ea59e7bf6bab45356&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:24.715936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0c04-61b4-4a00-9bfa-0794d64ed646 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:24.716437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0c04-61b4-4a00-9bfa-0794d64ed646 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:24.716510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0c04-61b4-4a00-9bfa-0794d64ed646 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:24.718197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 224/456] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:24.723701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53475a5-13cb-46d0-899b-7eaa1f4799f7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:24.724140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53475a5-13cb-46d0-899b-7eaa1f4799f7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:24.724223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53475a5-13cb-46d0-899b-7eaa1f4799f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:24.746479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a53475a5-13cb-46d0-899b-7eaa1f4799f7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:24.747985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a53475a5-13cb-46d0-899b-7eaa1f4799f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:24.842352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 233/457] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:24.880920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59f91-a1ce-4000-ac42-8db844f86124 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:24.881555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59f91-a1ce-4000-ac42-8db844f86124 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:24.882037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59f91-a1ce-4000-ac42-8db844f86124 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:24.883821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 225/458] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:24.889428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5527f88-8491-42aa-819b-79c5663987e7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:24.890285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5527f88-8491-42aa-819b-79c5663987e7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:24.890427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59f91-a1ce-4000-ac42-8db844f86124 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:24.891007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5527f88-8491-42aa-819b-79c5663987e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:24.914476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e5527f88-8491-42aa-819b-79c5663987e7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:24.915651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e5527f88-8491-42aa-819b-79c5663987e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:24.991297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.029541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 234/459] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:25.036698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59f91-a1ce-4000-ac42-8db844f86124 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.038059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b8a4-4f82-42c0-8498-ffc71458a601 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.038511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b8a4-4f82-42c0-8498-ffc71458a601 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.038793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b8a4-4f82-42c0-8498-ffc71458a601 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.040385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 235/460] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:25.047167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.047452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.047724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.055137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.070262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:25.071472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:25.086491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.088256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.088784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.089523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.101175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.102765 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:25.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:25.122132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:25.122951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:25.122951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:25.122951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:25.122951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:25.127677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 226/461] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:25.128790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.150779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 236/462] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:25.151852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.261591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f51f-724e-4b91-b1ab-0924d35bfe86 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.273303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cff3c-7013-48cf-8170-d7dc33fdeeed None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.295797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.302398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.303577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.304099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.304598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.305592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.305813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:25.306322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.308197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.333587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.334173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 237/463] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:25.335223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.337023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.337537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.338034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.352520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.355027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:25.380768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:25.381745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:25.382579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:25.382579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:25.382579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:25.382579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:25.389328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 227/464] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:25.389328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.457279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9c06-81e7-4c25-b6b9-1e5047afe285 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.494004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ee99f-fb3b-4998-be7c-3e8d12fbf471 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.495807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.496608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.496918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.497193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.508114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.509629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:25.528706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:25.529545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:25.530483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:25.530483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:25.530483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:25.530483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:25.530483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 238/465] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:25.530747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.537251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20889981-6076-4ce7-938c-09ece7a1dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.537940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20889981-6076-4ce7-938c-09ece7a1dee6 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.538222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20889981-6076-4ce7-938c-09ece7a1dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.538499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20889981-6076-4ce7-938c-09ece7a1dee6 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.539213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20889981-6076-4ce7-938c-09ece7a1dee6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.540696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20889981-6076-4ce7-938c-09ece7a1dee6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.565935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 228/466] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:55:25 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:25.567640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d22b-49f7-40d4-b4a2-b0def356b61a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.568252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d22b-49f7-40d4-b4a2-b0def356b61a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.568701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d22b-49f7-40d4-b4a2-b0def356b61a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.571384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 229/467] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:25.572461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024d22b-49f7-40d4-b4a2-b0def356b61a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.583687 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.609760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.653742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668228-4156-4ca4-979e-90f3e585e1cf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.704189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.705101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.705631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.706081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.707085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:25.707404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.707622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024d22b-49f7-40d4-b4a2-b0def356b61a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.708910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf4871-a08d-44d6-bd78-1fb876544a5b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.731562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 239/468] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:25.733269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.733603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.733885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.749414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.750869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.751380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.751847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.752725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:25.753022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:25.753522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.754026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:25.755378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.769775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 230/469] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:25.770985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.839659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 240/470] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:25.840657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:25.883688 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.901771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:25.916897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784810b-8147-41fd-a83a-151d86e4fcaa None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.956269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:25.957267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:25.957758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:25.958210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:25.959089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:25.960954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:25.967285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216aa34-0782-46bf-b739-df15ff8be63b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:25.984350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 231/471] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:55:25 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:25.985554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:26.008482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c498-2c88-4239-bc5e-1e83b286218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.009271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c498-2c88-4239-bc5e-1e83b286218d None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.009650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c498-2c88-4239-bc5e-1e83b286218d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.009991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c498-2c88-4239-bc5e-1e83b286218d None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.010831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c498-2c88-4239-bc5e-1e83b286218d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:26.012583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c498-2c88-4239-bc5e-1e83b286218d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:26.039701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 241/472] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:55:25 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:26.041867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e691-4ff3-4682-8dbc-0cd802324ce4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.042157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e691-4ff3-4682-8dbc-0cd802324ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.042493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e691-4ff3-4682-8dbc-0cd802324ce4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.044744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 242/473] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:26.051011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.051453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.051836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.071051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:26.072562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:26.120780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649204d4-e2f2-4527-8a86-64ff9d7f9cc7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:26.157604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 243/474] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:26.161425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.162590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.163021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.163439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.177139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:26.179447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:26.179617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:26.183122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:26.203597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:26.204706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:26.205749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:26.205749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:26.205749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:26.205749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:26.207746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 232/475] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:26.212291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:26.214259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:26.310233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe9629-cc9b-44f6-970c-bce64d568d89 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:26.339030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527f9fd-a5c9-45e8-83a7-f199501cc04f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:26.354122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.354799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.355080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.355354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.356356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:26.358301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:26.367642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.sql.core [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 16:55:26.367642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 16:55:26.367642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [parameters: {'id': '18c096e3c8004aeaa04a785942137766', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 16:55:26.367642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80162) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 16:55:26.384237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.385344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.385852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.386334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.387347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application conn.query(q) May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application result.read() May 25 16:55:26.387547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return ref.to_dict() May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:55:26.388431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application next(self.gen) May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application yield resource May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application next(self.gen) May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.session.rollback() May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.force_reraise() May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise self.value May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application session.commit() May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 16:55:26.389487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._prepare_impl() May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.session.flush() May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._flush(objects) May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application compat.raise_( May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application flush_context.execute() May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rec.execute(self) May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 16:55:26.390405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:55:26.391278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application conn.query(q) May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application result.read() May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:55:26.393926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [parameters: {'id': '18c096e3c8004aeaa04a785942137766', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:26.396035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 16:55:26.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:26.400174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 244/476] 10.222.0.31 () {60 vars in 1131 bytes} [Wed May 25 16:55:26 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:26.400174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:26.402384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:26.402901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:26.422480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 233/477] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:26.428458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:26.492461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:26.534481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:26.538600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d1dc9-ec3f-483e-ba67-a14ee357c5c9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:26.575355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.576269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.576713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.577056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902a019-c95b-4399-a389-1075e9a401c1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:26.577347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.578205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:26.579785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:26.610955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 234/478] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:55:26 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:26.636369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc728-2921-4163-81f4-4a9fdbc44639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.637440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc728-2921-4163-81f4-4a9fdbc44639 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.637877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc728-2921-4163-81f4-4a9fdbc44639 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.638285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc728-2921-4163-81f4-4a9fdbc44639 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.651629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcc728-2921-4163-81f4-4a9fdbc44639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b0fcc728-2921-4163-81f4-4a9fdbc44639 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:26.660874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:26.662010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:55:26.662989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:26.669966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 245/479] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:55:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:26.671726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:26.784950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c593-741e-43cb-9bd9-90e4104616ed None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:26.803577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:26.831322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:26.832008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:26.832290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:26.832565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:26.833361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:26.833667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:26.835081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98215da-e0c2-4728-862f-5a1cb0fa2e1d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:26.848817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 235/480] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:28.305602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e379e2a-d62d-462d-908e-36ae2e28afb0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:28.306147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e379e2a-d62d-462d-908e-36ae2e28afb0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:28.306147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e379e2a-d62d-462d-908e-36ae2e28afb0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:28.307803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 246/481] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:28.314028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:28.314461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:28.314609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:28.335333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:28.336644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:28.436066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 236/482] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:28.463621 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e379e2a-d62d-462d-908e-36ae2e28afb0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:28.606273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e379e2a-d62d-462d-908e-36ae2e28afb0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:28.651704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:28.652878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:28.653389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:28.653859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:28.669765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:28.692460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:28.697524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:28.698302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:28.700603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 247/483] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:28.707366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:28.895770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a990-0a59-4b66-9581-0240f35fbe94 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:28.898117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:28.948787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:28.949467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:28.949754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:28.950033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:28.950792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:28.951104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:28.953096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adee154-febc-48b7-99f1-c7db0f04dd8a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:28.968363 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 237/484] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:28.974186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:28.993316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.022127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d00ae-4586-48f5-b6f4-411ee5e64cae None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.022472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d00ae-4586-48f5-b6f4-411ee5e64cae None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.022701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d00ae-4586-48f5-b6f4-411ee5e64cae None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.024338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 238/485] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:29.032476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.032821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.033071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.067781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:29.069064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:29.171556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ba95e-fda2-4ab2-b777-c6375e74521c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.195101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 239/486] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:29.234855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.235666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.235952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.236230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.247057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.261524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:29.264276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0fb1e795-d428-49bb-b42f-89a8782e5740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:29.282063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:29.283001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:29.283836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:29.283836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:29.283836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:29.283836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:29.283836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 248/487] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:29.285231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5856-ac30-45f3-974c-5f90e6040c89 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.285523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5856-ac30-45f3-974c-5f90e6040c89 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.285798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5856-ac30-45f3-974c-5f90e6040c89 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.287651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 249/488] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:29.292713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5856-ac30-45f3-974c-5f90e6040c89 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.354492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.364447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.370914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a084-7b5c-4564-9ed5-9a7c45b4e988 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.409595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829917fa-45c8-441d-84a3-71db099062a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.410409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829917fa-45c8-441d-84a3-71db099062a8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.410695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829917fa-45c8-441d-84a3-71db099062a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.410975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829917fa-45c8-441d-84a3-71db099062a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.411915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5856-ac30-45f3-974c-5f90e6040c89 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.425853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829917fa-45c8-441d-84a3-71db099062a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-829917fa-45c8-441d-84a3-71db099062a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:29.436039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:29.437827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:29.438612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:29.440745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 240/489] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:29.442281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef703-d97c-4c8f-8000-48ef2928b5ca None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.442777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef703-d97c-4c8f-8000-48ef2928b5ca None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.443242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef703-d97c-4c8f-8000-48ef2928b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.461324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.462037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.462310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.462589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.463305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-96eef703-d97c-4c8f-8000-48ef2928b5ca None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:29.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:29.463634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:29.465103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:29.465334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96eef703-d97c-4c8f-8000-48ef2928b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:29.484543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 250/490] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:29.485856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.548841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 241/491] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:29.550610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e210e-5dd0-4ec7-9a49-ee30566a7176 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.550902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e210e-5dd0-4ec7-9a49-ee30566a7176 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.551183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e210e-5dd0-4ec7-9a49-ee30566a7176 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.552658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 242/492] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:29.553626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e210e-5dd0-4ec7-9a49-ee30566a7176 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.605554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa582f5-506a-475c-bedd-952506004eec None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.623757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.647482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.648151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.648432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.648730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.649246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.649479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:29.649789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:29.651400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab346cd-0d4a-4248-b77c-dad1e096ef30 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:29.661325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 251/493] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:29.662557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5850f6-9b6c-4237-bfad-90f3d1a2d553 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.662846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5850f6-9b6c-4237-bfad-90f3d1a2d553 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.663160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5850f6-9b6c-4237-bfad-90f3d1a2d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.670434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e210e-5dd0-4ec7-9a49-ee30566a7176 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.679142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bd5850f6-9b6c-4237-bfad-90f3d1a2d553 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:29.680324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bd5850f6-9b6c-4237-bfad-90f3d1a2d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:29.710152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.710951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.711229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.711508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.719051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:29.720528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:29.736409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:29.737371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:29.738255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 243/494] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:29.738802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.749872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 252/495] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:29.751445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c6bb5-c235-44a5-a326-f243239582d1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.751739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c6bb5-c235-44a5-a326-f243239582d1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.752020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c6bb5-c235-44a5-a326-f243239582d1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.753280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 253/496] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:29.753964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c6bb5-c235-44a5-a326-f243239582d1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.845066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b4f-2478-46d8-bdd4-b69ffa46a1d4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.864108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c6bb5-c235-44a5-a326-f243239582d1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:29.873728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.879073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.880131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.880131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.880386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.891514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:29.899234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:29.900100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:29.901197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:29.901958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:29.901958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.902110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 244/497] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:29.902175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.902175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.902289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:29.912550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:29.914061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:29.914492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-90d2e4a7-482c-4735-8bc0-5497a0e3c223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:29.933031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:29.934445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:29.935278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:29.935278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:29.935278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:29.935278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:29.935278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 254/498] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:29.935548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:29.935910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:29.936168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:29.953861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:29.955039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:30.012635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60262-6e06-433e-bda0-10a54950b549 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.022290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 255/499] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:30.023127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.059240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.059906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.060186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.060459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.061357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:30.062187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.064063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.100216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 245/500] 10.222.0.31 () {56 vars in 1137 bytes} [Wed May 25 16:55:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:30.101074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.114844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.125174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3beeb-1dcc-45e7-a520-27833e00b090 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.160298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.161118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.161401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.161677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.165639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.172756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:30.180330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:30.181281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:30.182083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 256/501] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:30.182725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.206740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677cba-a4db-41b1-b7ae-ed285f851861 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.240808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.241474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.241760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.242037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.242787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:30.243098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.244488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.253825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 246/502] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:30.254938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.287742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfeffaa-1f5f-46c1-9439-8a33b22605c5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.321844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.322499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.322778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.323054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.323761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:30.324064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.325464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.337022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 257/503] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:30.337817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.351317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.354888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62caaca-526c-4bae-a13c-03c98bd3a577 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.381093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.390530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.391383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.391672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.391955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.402490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.403998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:30.422275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:30.423134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:30.423967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:30.423967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:30.423967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:30.423967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:30.423967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 247/504] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:30.424230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.445318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b100d-50c0-4872-8e0d-c88fc96d84db None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.479892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.480471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.480788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.481068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.523012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d7f2-cdd9-4287-8bb7-3d451869b432 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.549478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.550927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.557333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.557991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.558279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.558554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.559293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:30.559597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.560989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.561791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.570047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 248/505] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:30.570658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.625605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.648847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 258/506] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:30.649667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.688887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7888630-9df3-434e-a2a8-b4e0c1778beb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.725168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.726080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.726749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.727029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.738702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.740098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.751103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f431c-6c1b-4d10-8dd9-246cd7cbcdc5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:30.756781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:30.757792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:30.758641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:30.758641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:30.758641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:30.758641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:30.758641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 249/507] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:30.758915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.767414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.792060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.792890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.793175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.793457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.800914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.802353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:30.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:30.819387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:55:30.820256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:30.821288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 259/508] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:30.821778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.853862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:30.863729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2518-9904-4bc2-a8c4-0690ad466a04 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.899048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.899708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.899989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.900265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.901013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:30.901321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.902690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.915479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 250/509] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:30.916280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:30.927506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03f86-c213-4d7c-967f-c550d4f58bf9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:30.962733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:30.963536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:30.963819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:30.964094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:30.975191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:30.976646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:30.995089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:30.996093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:30.997402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:30.997402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:30.997402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:30.997402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:30.997402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 260/510] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:30.997402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.019651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f805e-1824-4164-97c7-354ccbf8b359 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.021177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.053968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.054758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.055042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.055318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.065798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.067259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:31.085072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:31.086003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:31.086850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:31.086850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:31.086850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:31.086850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:31.086850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 251/511] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:31.087446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.090966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.101799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f6880-ebce-4a8b-be72-6113ad5d7982 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.136254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.136947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.137230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.137505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.138218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:31.138524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.140631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.151828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 261/512] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:31.152588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.191460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e518077-f27f-4201-b1bb-1d8167a37f9a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.224873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.225532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.225813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.226089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.226922 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:31.227238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.228710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.233877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.246643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 252/513] 10.222.0.31 () {56 vars in 1137 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:31.247384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.257299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb7470-b8d5-4cd9-a73b-42451fe3678a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.291564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.292231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.292515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.292834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.293535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.294966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.305915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.316955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 262/514] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:55:31 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:31.317750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.351766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d1dd-c64b-476b-bda8-06f17d432a2e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.390450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.391238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.391400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.391681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.392416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:31.392757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.394201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.413052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 253/515] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:31.413052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.447106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79424e4-5181-4b1a-9704-d724d829a367 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.492513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.493224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.493512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.493786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.495149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:31.495465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.497409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.509115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.515701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 263/516] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:31.517093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.524414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e7b8d-f16f-4c32-80fb-4ce42c942282 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.550464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.569347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.570147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.570434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.571170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.583184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.584654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:31.599219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:31.600126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 254/517] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:31.601450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.644062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ac7d-936c-485b-b742-39eabd572421 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.686414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.687926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.688171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.688451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.728742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbef9e-45d0-48ed-a0ca-781b221bc02e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.763796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.764418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.765298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.765624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.765968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.769894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.771597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.773789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.775222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:31.789255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:31.790378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:31.791300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 255/518] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:31.791844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.840469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:31.893427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 264/519] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:31.894371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.908472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943c00-ff71-4a7e-b846-490dcd73788c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:31.947488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:31.948652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:31.949154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:31.949726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:31.957889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:31.959795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:31.975649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:31.976795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:31.977856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:31.982733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 256/520] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:31.983510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:31.996209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.001547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca57f-0ed1-4a09-ab4f-f038af0d9018 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.039013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.039603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.040218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.040218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.041009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:32.041322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.042764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.081665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 265/521] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:32.081665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.095007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8f52e-57d8-4e6c-a8e3-f412621f859d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.096582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.133446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.134124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.134407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.134681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.135524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:32.135838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.137328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.157102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 257/522] 10.222.0.31 () {56 vars in 1139 bytes} [Wed May 25 16:55:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:32.158315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.203705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcd80b-c24a-49ec-a0bc-9999729349dd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.239811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.240739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.241028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.241303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.252816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.254572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.262838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e26bf-84ee-4512-b3d0-a820aed7fc22 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:32.272920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:32.273744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:32.274659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:32.274659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:32.274659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:32.274659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:32.274659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 266/523] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:32.275320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.287153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.306268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.306861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.307149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.307687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.308216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:32.308530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.310019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.329445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 258/524] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:32.329445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.354459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.390973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108916cd-3a02-4879-9b57-582987afc7cb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.429187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.430086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.430784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.431069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.439872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9c11-90c4-4649-bd0f-135f55de1d3c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.474315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.474979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.475267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.475538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.520191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.521804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.532624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.550888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.552367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.575937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.633724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 267/525] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:32.634910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.671647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 259/526] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:32.671647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.744305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d6c0-b5f3-4cf2-9d89-b9c35e5bd4f2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.755578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.776729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee135-f577-41ef-9108-cb607c001479 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.782858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.783509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.783787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.784054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.784784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:32.785088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.786434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.802888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 268/527] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:32.802888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.803840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:32.815780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.816436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.816740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.817018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:32.817848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=e29e245b61634d66bcca79fe530c6019) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:32.818158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:32.819580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:32.832792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 260/528] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/role_assignments?user.id=e29e245b61634d66bcca79fe530c6019&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:32.832792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:32.952415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c596b-b052-46eb-9e9b-7f9df7ec5164 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.953667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce9a74-7563-4eb9-8646-09c9a6485b7a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:32.992248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:32.993085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:32.993364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:32.993793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.000390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.001389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.002333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.002719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.007042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.008533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.017253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.019684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:33.031777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:33.032720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:33.033588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:33.033588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:33.033588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:33.033588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:33.038019 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 269/529] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:33.039023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:33.042341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:33.043174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:33.043987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:33.043987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:33.043987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:33.043987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:33.048347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 261/530] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:33.049271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.063955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.109202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.168972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d549ea-d67d-4320-a95d-d8abfaa41b6a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.177958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468bd4f-9022-4dd5-952b-41f8c0fb21a3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.208711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.210427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.210856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.211280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.214572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.215408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.215839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.216262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.217165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.218191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.219112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.219880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.220558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.232928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 262/531] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:33.234134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:33.244315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:33.245421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:33.246340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 270/532] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:33.246806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.349592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.356968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b9d6-511f-442b-8866-81e199872c28 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.358373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.383844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac71f-1903-4e65-95e3-113743b05713 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.404033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.404033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.404033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.404033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.404469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.404469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.405673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.420452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 263/533] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:33.422081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.430411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.431225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.431502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.431777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.440609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.442180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:33.457513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:33.458378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:33.459206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:33.463447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 271/534] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:33.464379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.533668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1665c-081e-49f2-a923-22c94791e11d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.571535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.572424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.572892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.573242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.574097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.574472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.575708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98ae2-7b89-4d3c-9056-a6db9efef30e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.576197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.589459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 264/535] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:33.590645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.611402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.613655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.614521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.614801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.615075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.623496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.625161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.628070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:33.641674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:33.642512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:33.643331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 272/536] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:33.643809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.718612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b26bf-4392-497c-a992-9129daa6a759 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.754105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3253f9-3e22-4976-ab55-6da689f6e6ae None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.755531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.756192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.756717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.756847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.757555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.757863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.759309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475085-fb5f-48f3-8cbf-b755053488eb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.772929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 265/537] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:33.773967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80afc-b3a1-4196-9642-873781e1128a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.774255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80afc-b3a1-4196-9642-873781e1128a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.774529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe80afc-b3a1-4196-9642-873781e1128a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.780643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 266/538] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:33.780643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80afc-b3a1-4196-9642-873781e1128a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.797139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.797791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.798084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.798339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.799156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=ca966a266e17460b8e38790f506eb406) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.799464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.800906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.806606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 273/539] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/role_assignments?user.id=ca966a266e17460b8e38790f506eb406&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:33.807203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:33.881918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.893337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:33.923164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe80afc-b3a1-4196-9642-873781e1128a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.941237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9631a2-d02a-465d-af98-ab8168d3ce16 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:33.975203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.976448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.976938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.978743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.980443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.981078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.983303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64b0e-9b70-42de-aa3c-72602ee17089 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:33.984916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:33.985761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:33.986108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:33.986414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:33.988420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=600d472e73da4c96af486c16a3f7df81) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:33.988840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:33.990564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:34.000578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 267/540] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:34.002395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:34.002959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:34.003449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:34.006460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 274/541] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:33 2022] GET /identity/v3/role_assignments?user.id=600d472e73da4c96af486c16a3f7df81&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:34.014180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:34.023804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:34.025428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:34.113316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 268/542] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:34.156311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:34.195193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef73aa-5e06-423c-a6d9-18c55d0f6dd9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:34.225771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:34.240301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:34.241007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:34.241285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:34.241575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:34.244821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=722c501d471d402b9b7eb5879b103ec7) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:34.245146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:34.247951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:34.260539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 275/543] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:34 2022] GET /identity/v3/role_assignments?user.id=722c501d471d402b9b7eb5879b103ec7&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:34.347424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:34.447095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df92e6-1011-4a5b-a76e-473259ed297d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:34.536600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:34.538562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:34.538562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:34.538562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:34.553468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:34.571980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:34.573007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:34.573800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:34.578767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 269/544] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:34.589735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:34.811104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a7e7-ec9a-4ab5-80d7-d2d617910b72 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:34.847975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:34.848650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:34.848963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:34.849243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:34.849993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:34.850302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:34.851796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:34.861924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 276/545] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:34.867173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.018052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff859a0-7415-4330-8d73-2f6e34e66423 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:35.057082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:35.058053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:35.058848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.059115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.059453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.075969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:35.077486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-2fbb1308-f8f9-4069-b6ba-15bd0bf00403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:35.107784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:35.109473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:35.110330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:35.110330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:35.110330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:35.110330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:35.110330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 270/546] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:35.117894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.230319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:35.282347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0a7c-da83-4ce2-8e07-ab1349a33cc7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.282718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0a7c-da83-4ce2-8e07-ab1349a33cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.282948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0a7c-da83-4ce2-8e07-ab1349a33cc7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.284539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 271/547] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:35.289359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.289747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.290123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.290235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3867d-0c3d-4230-9fef-13b94d3255fe None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:35.310273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:35.311770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:35.346703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:35.347433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.347730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.348008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.348869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:35.349184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:35.350587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:35.377785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 277/548] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:35.393911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.395223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 272/549] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:35.432776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.537093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e603f-f006-4326-b12d-13d73f9b779b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:35.553637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:35.576563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:35.578335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.578798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.579206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.587245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:35.589014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:35.606086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:35.608252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:35.609763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:35.616477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 278/550] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:35.617844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.726616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faf3a6-52b0-48ed-ae41-e3610fe7d050 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:35.754609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad034dc1-87cd-45e9-ac86-31b45aeace8a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:35.766476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:35.767325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.767787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.768227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.769226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:35.770200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:35.771791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:35.774961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:35.798631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 279/551] 10.222.0.31 () {56 vars in 1135 bytes} [Wed May 25 16:55:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:35.800722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.853074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:35.859323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:35.860024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.860307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.860580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:35.885762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:35.901710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:35.902945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:35.903960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:35.908835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 273/552] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:35.911101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:35.917834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7ca6-679b-4953-a1e1-ea6e4a129374 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:35.987828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:35.988741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:35.989192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:35.989606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.095814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac4e28-3cae-4c4a-bd10-f2a5840bb328 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:36.125886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:36.127419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:36.160164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:36.177426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:36.178178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.178474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.178746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.179555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:36.179869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:36.181354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:36.197022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 274/553] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:36.197929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:36.244102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 280/554] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:55:36.250500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:36.260375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:36.418390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fcdfd-b359-4858-a38a-2e5b2685dd41 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:36.422566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc4f5-27d4-44f9-8dae-4ca978a85e65 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:36.469808 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:36.478716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:36.479305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:36.479526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.479813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.480091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.480750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.481173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.481587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.494159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:36.495836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:36.501414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:36.502889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:36.517139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:36.518204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:36.519247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:36.519247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:36.519247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:36.519247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:36.521136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 275/555] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:36.526188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:36.544066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:36.545029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:36.547253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:36.547253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:36.547253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:36.547253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:36.550010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 281/556] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:36.563109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:36.705074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:36.741255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d18a90-9ade-43e3-922b-e6041ea7c352 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:36.779552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d688ef-7d60-44be-894f-04ca32e2cb9d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:36.800759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:36.802580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.803110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.803529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.804770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:36.805222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:36.807134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426e504-b331-4e9a-9e8e-88acf4443d4c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:36.824925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:36.825692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 276/557] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:36.825986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.826361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.826786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.827945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091279-44ee-41ad-9116-2fe9f2648001 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.828384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091279-44ee-41ad-9116-2fe9f2648001 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.828508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:36.828915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:36.829082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091279-44ee-41ad-9116-2fe9f2648001 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.830507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5875de8-c9e7-4973-a89a-55ef72c764a7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:36.831124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 277/558] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:36.832027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1091279-44ee-41ad-9116-2fe9f2648001 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:36.848716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 282/559] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:36.850386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80497-48c6-4cfc-a7a3-d3acc3720c4f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.850681 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80497-48c6-4cfc-a7a3-d3acc3720c4f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.850956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80497-48c6-4cfc-a7a3-d3acc3720c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.869568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-90a80497-48c6-4cfc-a7a3-d3acc3720c4f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:36.870773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-90a80497-48c6-4cfc-a7a3-d3acc3720c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:36.917053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:36.956782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 283/560] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:36.956782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b227b9-329d-4252-a932-93b0860e960d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:36.956782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b227b9-329d-4252-a932-93b0860e960d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:36.956782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b227b9-329d-4252-a932-93b0860e960d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:36.957145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1091279-44ee-41ad-9116-2fe9f2648001 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:36.962083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 284/561] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:36.962960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b227b9-329d-4252-a932-93b0860e960d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.011082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.011880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.012160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.012433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.021655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.023620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-216c2846-bb63-484b-9ec2-766cee77d44c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:37.041347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:37.042316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:37.043260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 278/562] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:37.043852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.044202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.044366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.050262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.063333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:37.064502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:37.090685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b227b9-329d-4252-a932-93b0860e960d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.126504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.127303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.127585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.127854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.130820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 279/563] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:37.131729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.134564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.136006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1663c247-3ad8-4c78-b50c-ae2d10db37a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:37.149839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:37.150754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:37.151643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 285/564] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:37.152358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1aac1-8937-4ccc-a046-6168415c1081 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.152600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1aac1-8937-4ccc-a046-6168415c1081 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.152905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1aac1-8937-4ccc-a046-6168415c1081 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.154365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 286/565] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:37.155450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1aac1-8937-4ccc-a046-6168415c1081 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.193949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.235059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14d86-451f-4e03-8249-215c2b1d0a13 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.261100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1aac1-8937-4ccc-a046-6168415c1081 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.262700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.267941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.268756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.269038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.269309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.279409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:37.287564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:37.288555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 280/566] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:37.294370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.297047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.297717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.298001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.298325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.299168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:37.299479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.301002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.320433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 287/567] 10.222.0.31 () {56 vars in 1137 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:37.321556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.396523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def5ced-60ba-4d08-89c6-d18c854a98a9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.422342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.431387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5affc9-c4c7-4564-9827-c929f1b3b085 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.432181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea73645-9d4d-4768-98be-001480c10633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.433051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73645-9d4d-4768-98be-001480c10633 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.433359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73645-9d4d-4768-98be-001480c10633 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.433642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea73645-9d4d-4768-98be-001480c10633 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.445045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea73645-9d4d-4768-98be-001480c10633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cea73645-9d4d-4768-98be-001480c10633 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:37.453614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:37.454723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:37.455547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 281/568] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:37.456250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.456317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.456596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.470781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.471444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.471714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.471980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.472786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:37.473096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.473379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:37.474522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.474628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:37.496381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 288/569] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:37.496381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.522657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.542947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 282/570] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:37.543681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.594530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f325f27-1f23-4526-9074-f802243a8c4c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.628079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.628758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.629041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.629312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.630040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:37.630350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.631695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.644546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 289/571] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:37.644546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.644901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a2dc-4342-4198-ab63-995aef982c8f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.656820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.682853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.683659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.683932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.684201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.695039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.696471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:37.715049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:37.715949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:37.716954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:37.716954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:37.716954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:37.716954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:37.716954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 283/572] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:37.717234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.743242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f38d-64bf-43e8-a89f-601736e0d7ef None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.751066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.778335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.779038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.779322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.779596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.781156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:37.781470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.782962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.791231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 290/573] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:37.792016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.821181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2935-9f61-451a-95f9-e3e638ba1ba9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.857081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.857731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.858019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.858290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.859128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=a7d82cb54434427d816780c435562667) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:37.859444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:37.861273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:37.866630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 284/574] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/role_assignments?user.id=a7d82cb54434427d816780c435562667&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:37.867411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.875506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.901433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac6a8-3ec9-4115-bdd7-214ab506f5b2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:37.942976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:37.944277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:37.944565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:37.944883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:37.958578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:37.967070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:37.968669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 291/575] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:37.969823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:37.989901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:37.994516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5f5a6-0a82-4ecd-8712-a740aebf6d22 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.039517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.040396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.040712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.041341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.055749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.057036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:38.076354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:38.078321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:38.079207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:38.079207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:38.079207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:38.079207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:38.079207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 285/576] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:38.079207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.086415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d077-e95f-4af0-aca9-1a792b04391e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.120253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.120943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.121222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.121491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.122202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:38.122505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.124416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.126820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.137561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 292/577] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:38.143552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.186754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3853-2f59-4b5d-8632-e7d6a4823394 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.223929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.224744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.225065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.225371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.238728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.240377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.253532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffbca6-ade5-4f7b-bb42-f3b68be5ff12 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:38.259962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:38.260868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:38.262292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:38.262292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:38.262292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:38.262292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:38.262292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 286/578] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:38.262585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.268533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.294628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.295216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.296076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.296347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.297122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:38.297427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.298780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.307293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 293/579] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:38.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.370369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.387679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641848cd-232c-4fe8-b0ca-71b9580fb1d8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.415735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01714-c00e-40ee-8650-d4ac5d85cb8e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.423915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.424576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.424885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.425160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.425876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:38.426183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.427550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.441044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 287/580] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:38.446031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.453945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.454745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.455033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.455311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.462317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.463810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:38.478729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:38.479605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:38.480589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:38.484834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 294/581] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:38.485863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.510997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.550852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd479-73ac-4cc0-aa66-19fa5dedfeab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.595356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.597001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.597587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.598152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.598890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:38.599202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.599753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0272-97d7-46b9-b752-a813b91d5d80 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.600594 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.612898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 288/582] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:38.613722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.620712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.639284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.640319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.640601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.640904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.652871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.654590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:38.674087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:38.675059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:38.675926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:38.675926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:38.675926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:38.675926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:38.679942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 295/583] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:38.680836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.734287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52287d8-92ad-46ba-8aef-42abd5af59e3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.757579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.775131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.776307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.776810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.777242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.785762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.787437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.793193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02201d6-f785-486a-a6cf-9a3a570ae668 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:38.802802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:38.803918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 289/584] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:38.810167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.841824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.843100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.843458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.843807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.844729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:38.845111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.846665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.864409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 296/585] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:38.864409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:38.896605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:38.925428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2a9ac-58b1-47e7-abca-037d6b697410 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.962169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:38.962972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:38.963257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:38.963537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:38.972178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:38.973662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:38.975299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb8627-40b5-4d03-8565-fbc51fa5bcd4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:38.988970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:38.990372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:38.991896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:38.995388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 290/586] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:38.996291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.019375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.020152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.020506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.020875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.021663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:39.022039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.023993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.037970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 297/587] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:39.038867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.047521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.116374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e673ef-262e-4f33-be50-a273273dcfea None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.137083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.149452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203a61e-5707-4817-bd42-dcb38f45bd1a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.153424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.154100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.154385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.154660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.156060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:39.156375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.157869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.181742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 291/588] 10.222.0.31 () {56 vars in 1137 bytes} [Wed May 25 16:55:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:39.182599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.185763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.187889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.188171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.188443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/e29e245b61634d66bcca79fe530c6019/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.205147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=e29e245b61634d66bcca79fe530c6019, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.206764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.223658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 298/589] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:55:39 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/e29e245b61634d66bcca79fe530c6019/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:39.224791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.295068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.300822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc54ea-0af1-4d7b-ae0e-83e8a612e2df None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.345893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.346741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.347114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.348196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.348525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:39.348973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.350608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.370966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 292/590] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:39.371954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.391323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ca867-c1e1-49f4-ad49-93e7bb77f7f3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.447969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.449505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.449505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.449505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.458982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.460441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.464105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:39.481692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:39.483025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:39.484030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 299/591] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:39.484666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.499446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed402f11-8f96-4393-96da-64653b778d9f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.551381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.552659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.553076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.553456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.567926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.570002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:39.594308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:39.595454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:39.596583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:39.596583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:39.596583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:39.596583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:39.598010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 293/592] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:39.598220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84be1c4-4ac1-414d-a6f6-e5f7874f8c41 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.603347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.619238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.639235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.640866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.641382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.641861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.653240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.655139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:39.675609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:39.676550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:39.677457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:39.677457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:39.677457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:39.677457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:39.679679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 300/593] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:39.680826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.739885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68f736-b0d5-4e3e-994b-da97d9ab5ed1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.752145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.779882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.780978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.781482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.782047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.783176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:39.783785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.785609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.806507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 294/594] 10.222.0.31 () {56 vars in 1139 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:39.807734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.819251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18142c5d-f8ef-4421-9589-451fc866857f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.870247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.870919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.871207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.871487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.872469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:39.872815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.875431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.886010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:39.892903 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 301/595] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:39.894055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:39.930784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de65a-f9f4-4d18-943e-6239217921de None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:39.971793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:39.973002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:39.973603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:39.974106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:39.975042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:39.975662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:39.977398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:39.995349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 295/596] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:39.996564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.018321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fd0ea-b25f-4ebb-a3a9-15fee1a342b5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.034216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.060242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.061648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.061944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.062539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.074894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.076361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:40.095811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:40.096802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:40.097675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:40.097675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:40.097675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:40.097675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:40.101685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 302/597] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:40.102545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e952e0-5bee-4926-9402-c59e6eda68b8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.150916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.161522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.162714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.163236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.163718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.172142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.174079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:40.190698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:40.191630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:40.192516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:40.199464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 296/598] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:40.200715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.213850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5b93-7600-4481-825e-6878966d7010 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.252130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.252500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.252857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.253153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.260092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.261562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:40.276071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:40.277269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 303/599] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:40.278920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.309488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.331481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dbefa-e5fb-4362-b85d-5fa7357ccfeb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.370548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.371215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.371504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.371769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.372500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:40.372834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.374319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b3dc-ea83-4f7d-a1fb-83a7119d8581 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.388763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 297/600] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:40.390652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d448255-8ca0-4774-883b-f1a06a8e5777 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.390943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d448255-8ca0-4774-883b-f1a06a8e5777 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.391223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d448255-8ca0-4774-883b-f1a06a8e5777 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.396853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 298/601] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:40.396853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d448255-8ca0-4774-883b-f1a06a8e5777 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.402699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400af5d-cc27-4026-8e9a-4afed808f0ab None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.442895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.443565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.443849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.444124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.444938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:40.445253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.446694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.453336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.460630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 304/602] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:40.461296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.515770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d448255-8ca0-4774-883b-f1a06a8e5777 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.551795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.552487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.552818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.553092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.553886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:40.554195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.555637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15fb58-a25c-4bc6-8003-ec3aee9a7809 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.556492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.569599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 299/603] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:40.574953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460b80-81ab-43ed-a4c7-85ca0987340f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.575281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.575569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.575843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.594533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:40.595736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:40.613492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.614297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.614579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.614857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.622254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.624252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:40.638463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:40.639972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:40.641004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 305/604] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:40.642365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.677176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 300/605] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:40.678101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.738252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.762827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00ed3-9d66-4571-b501-aa9eb24acd06 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.799653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.800551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.800877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.801151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/ca966a266e17460b8e38790f506eb406/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.815299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c33f71-d1ef-4456-883c-33ebf5157dd6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:40.819501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=ca966a266e17460b8e38790f506eb406, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.820989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.823369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:40.840912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 306/606] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:55:40 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/ca966a266e17460b8e38790f506eb406/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:40.844156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.855706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:40.856643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:40.856961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:40.857240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/600d472e73da4c96af486c16a3f7df81/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:40.875114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=600d472e73da4c96af486c16a3f7df81, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:40.876658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:40.894890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 301/607] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:55:40 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/600d472e73da4c96af486c16a3f7df81/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:40.895764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:40.995609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf9ed-0ee4-437e-80fa-085aa86a56d9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.004396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:41.039690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eb66b-e352-4c80-9fb7-48da3e8831d8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.056784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:41.057953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.058469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.058984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.060055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:41.060636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:41.063174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:41.083511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 307/608] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:41.089615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:41.150684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:41.151867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.152357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.152882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.160991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:41.180191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:41.192788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:41.193824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:41.194680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:41.197563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 302/609] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:41.204176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:41.215955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b2bc-6f13-4a01-84a1-4a5165aa1595 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.262897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:41.264707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.267902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.268436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/722c501d471d402b9b7eb5879b103ec7/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.289039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=722c501d471d402b9b7eb5879b103ec7, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:41.290518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:41.308387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 308/610] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:55:41 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/722c501d471d402b9b7eb5879b103ec7/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:41.359023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ddf03-4c64-4e33-a384-637d0a0bcb05 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.401799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:41.402948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.403474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.403980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.405666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:41.406322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:41.408104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9f21-cd39-459b-8c60-6f70f1862e57 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:41.423692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 303/611] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:41.425498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:41.581188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb0b05-8961-4d91-8e34-e8212db8168d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.584999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:41.610173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2c51c-ee4a-413b-a9e7-5ab58cc2bc52 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.610527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2c51c-ee4a-413b-a9e7-5ab58cc2bc52 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.610737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2c51c-ee4a-413b-a9e7-5ab58cc2bc52 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.612353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 304/612] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:41.617956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.618255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.618538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.637008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:41.638214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:41.641780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:41.644245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:41.645204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.645493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.645772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.671219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:41.672754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:41.698166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:41.699086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:41.699964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:41.699964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:41.699964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:41.699964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:41.710514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 309/613] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:41.713981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:41.759777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 305/614] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:41.789849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:41.911628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e880480-80ea-4c0c-abed-9bcb218dc99f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.959266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a938-8a9c-4c9d-9c73-c2d2d53099ce None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:41.989520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:41.990306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:41.990628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:41.990929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:41.991725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:41.992096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:41.997061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.020298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 310/615] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:42.024947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.026780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.027507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.027846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.028149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.057163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:42.066830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:42.077097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:42.078040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:42.078874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 306/616] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:42.089246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.089849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:42.253593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f9c4-24b2-4b9f-9914-f0f19c388813 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:42.299219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541fea0-bf14-4767-8331-ffb9fd5e7bfb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:42.325914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.326907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.327253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.327577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.346560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:42.348163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:42.374932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:42.375938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:42.376876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:42.378732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 311/617] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:42.380033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.380892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.381188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.381508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.382389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:42.382719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:42.384270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.386954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.399043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 307/618] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:42.405318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.534309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:42.538747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:42.586227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99bfd6-df83-4c9f-8f90-62e51036455b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:42.614333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77782-fd7a-4e6b-ba94-248badf0b18a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:42.626153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.627016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.627496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.627808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.649288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:42.650936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:42.687760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:42.688807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:42.689694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:42.689694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:42.689694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:42.689694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:42.690414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 308/619] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:42.697494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.707161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.707841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.708127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.708405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.709273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:42.709587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:42.711035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.753170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 312/620] 10.222.0.31 () {56 vars in 1135 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:42.762829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.857876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5273-2d98-49c7-9e6b-3c311f305a41 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:42.873140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:42.884241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c833-154e-4620-96f2-e10069e5dc90 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:42.916940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.917671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.918000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.918276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.919001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:42.919307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:42.920976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.922114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:42.922924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:42.923212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:42.923494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:42.925598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:42.936973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 309/621] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:42.945507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:42.946758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:42.948239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:42.978112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:42.979060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:42.979944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:42.979944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:42.979944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:42.979944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:42.979944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 313/622] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:42.989678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.079957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7fbdb-c330-4035-b183-7825ccc3605c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.119658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.120850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.121360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.122342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.141892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:43.145530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:43.164865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:43.166084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 16:55:43.167210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:43.171139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 310/623] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:43.176341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.189883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce42df5-600d-43e4-854c-69b9b8a9f6d1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.240080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.241240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.242546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.243692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.245806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:43.246521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:43.249217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:43.262060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:43.276343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 314/624] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:43.285928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.343244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:43.429702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13968622-accf-4331-9af6-cd7af9021714 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.439480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994fe20-9eb1-4cb2-8ca0-2e76b80457f9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.471648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.472470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.472773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.473050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.488927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:43.490380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:43.516382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.517087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.517390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.517653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.518506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:43.518823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:43.520271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4228e3d-fbdc-427e-bb91-c9a86ad83826 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-47b48b14-5216-4ba9-9ee4-5a8742ec64e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:43.523419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:43.524349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:43.525526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 315/625] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:43.526994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aa978-d31c-42c0-81e4-d6e0f2420e8e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.527379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aa978-d31c-42c0-81e4-d6e0f2420e8e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.527718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aa978-d31c-42c0-81e4-d6e0f2420e8e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.531360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 316/626] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:43.531989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aa978-d31c-42c0-81e4-d6e0f2420e8e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.553056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 311/627] 10.222.0.31 () {56 vars in 1137 bytes} [Wed May 25 16:55:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:43.554715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.555008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.555293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.576541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:43.579168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:43.672702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aa978-d31c-42c0-81e4-d6e0f2420e8e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.672897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 312/628] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:43.672897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.683944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:43.714087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:43.730269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.731251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.733802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.734192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.735182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:43.735568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:43.737903 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:43.756294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 317/629] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:43.757549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.819926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b382ebc-c8ef-44b4-8a26-b5d3a7535cad None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.861634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea453d3-0240-400e-a01f-ced53b31c9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.862297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea453d3-0240-400e-a01f-ced53b31c9cc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.862577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea453d3-0240-400e-a01f-ced53b31c9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.862852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea453d3-0240-400e-a01f-ced53b31c9cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.880833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559824-0987-401e-96c3-add102cf25ea None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:43.919301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:43.921124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:43.921473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:43.921761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:43.933396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:43.937925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea453d3-0240-400e-a01f-ced53b31c9cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:43.939354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea453d3-0240-400e-a01f-ced53b31c9cc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:43.942068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:43.943017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:43.943848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 318/630] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:43.944973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:43.967668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:43.975712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.050400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 313/631] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:44.051836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e2469-e259-4ab6-9308-31d9a60cd2e8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.052133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e2469-e259-4ab6-9308-31d9a60cd2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.052410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e2469-e259-4ab6-9308-31d9a60cd2e8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.056806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 314/632] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:44.056944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6853d6-2eee-4947-985c-22873139c0cd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.057048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e2469-e259-4ab6-9308-31d9a60cd2e8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.091886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c0b00-bbb4-4d6f-b8e4-8dd1053de339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.093455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0b00-bbb4-4d6f-b8e4-8dd1053de339 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.093729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0b00-bbb4-4d6f-b8e4-8dd1053de339 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.094061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0b00-bbb4-4d6f-b8e4-8dd1053de339 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/a7d82cb54434427d816780c435562667/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.111107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c0b00-bbb4-4d6f-b8e4-8dd1053de339 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=a7d82cb54434427d816780c435562667, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.112257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c0b00-bbb4-4d6f-b8e4-8dd1053de339 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.125447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 319/633] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:55:43 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/a7d82cb54434427d816780c435562667/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:44.126754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b9bea-0331-497e-9727-c8dbfe1c1aa6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.127043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b9bea-0331-497e-9727-c8dbfe1c1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.127319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b9bea-0331-497e-9727-c8dbfe1c1aa6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.133082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 320/634] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:44.133082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b9bea-0331-497e-9727-c8dbfe1c1aa6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.171711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e2469-e259-4ab6-9308-31d9a60cd2e8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.197956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.212848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.213542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.213828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.214108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.214876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:44.215186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.216602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1621335-21ca-4929-bb49-b7bc941e5189 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.221843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.232340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 315/635] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:44.232340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.232340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.232340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.250813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b9bea-0331-497e-9727-c8dbfe1c1aa6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.254028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:44.255404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:44.290952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.291755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.292041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.292315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.304042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.305550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4fdf4038-eb68-4839-8a03-78cbc36a7a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:44.324311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:44.325300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:44.326200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:44.326200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:44.326200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:44.326200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:44.327440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 321/636] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:44.328441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.332784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.333128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.340351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 316/637] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:44.341603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.354681 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:44.356212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:44.444261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 322/638] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:44.445273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.462856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbebb0-5bd8-4f11-bc02-41400b2008e6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.479174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.501674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.502470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.502749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.503016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.513190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.515562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.517093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:44.537166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:44.538117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:44.538992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:44.538992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:44.538992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:44.538992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:44.538992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 317/639] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:44.539355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.569613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0481-adc5-4e4d-ae35-a1506a9379f5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.609179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.609980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.610322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.610664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.611542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:44.611916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.613562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.633402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 323/640] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:44.633402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.657736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf8359-8678-4fa1-b4aa-98c969deadb3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.698157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.699258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.699543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.699824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.711529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:44.719626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:44.720563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:44.721460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 318/641] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:44.722150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.749869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.754296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca243-d6b0-4f90-a976-f5e058894bf5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.772981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.792589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.793466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.793752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.794363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.805234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:44.813943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:44.815176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 324/642] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:44.816236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.837681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13444006-cd78-4ab6-a95b-e5e608d0a594 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.876452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.877233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.877571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.877850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.878716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:44.879053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.880595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.895004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 319/643] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:44.900645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:44.927910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6dc87-2206-41fa-b2ea-0198bfab4ed8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:44.971139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:44.971885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:44.972212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:44.972495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:44.979770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:44.981239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:44.994842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:44.996698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:44.997560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:44.999413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 325/644] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:45.002017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.018340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8b229-86bc-457f-8318-9ce09e603661 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.044741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.054675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.055352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.055745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.056020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.056914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.057223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.058634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.073307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 320/645] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.073307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.113142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d975a-30f6-4f88-9d30-d77a3a5744df None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.160385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.161281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.161609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.161886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.162740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.163208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.165031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.180524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 326/646] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.180524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.189448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186490c-daa3-46c3-a97d-e189bddc3321 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.230063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.230889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.231259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.231571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.241824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.243690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:45.261965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:45.262959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:45.263959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 321/647] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:45.264592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.278236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.286693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.291106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f381-65f0-4bbb-ab7c-f17b6770f440 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.336955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.338131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.338969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.339351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.340207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.340527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.342599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.358408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 327/648] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.359371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.383011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fc2c9-1ab1-45bc-8337-4fa469709ee5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.418119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.418906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.419188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.419463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.430883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.432345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:45.449630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:45.450771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:45.451946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:45.451946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:45.451946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:45.451946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:45.455507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 322/649] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:45.456106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.481547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1889f9-9da2-4140-803f-e6017a289af2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.518698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.519481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.519757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.520026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.521665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.532092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.533563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:45.552363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:45.553565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:45.554659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:45.554659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:45.554659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:45.554659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:45.554659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 328/650] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:45.555004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.570391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.577574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a760-85c8-4491-9660-ee1999cacb08 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.617127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.617798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.618074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.618349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.619183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.619483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.620945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.638224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 323/651] 10.222.0.31 () {56 vars in 1137 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.639142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.677655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f03f5-53c1-4d37-9f63-5a2ecf91c0c4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.716935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.718492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.718940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.719217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.720047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=e29e245b61634d66bcca79fe530c6019) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.720358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.721840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.728011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 329/652] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/role_assignments?user.id=e29e245b61634d66bcca79fe530c6019&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.733934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.772365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c59e46-4ef6-42b6-b193-6bc8418eb385 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.799572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.825597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.826876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.827263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.827946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.828378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.828780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.830350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.847383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 324/653] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.848668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.849422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:45.883007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd13a5-a484-4633-bf4e-a5ee77767f08 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:45.929906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:45.930982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:45.931314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:45.931592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:45.932421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:45.932838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:45.934961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:45.947668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 330/654] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:45.948598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:45.979746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfc6b-ead4-426e-aaae-d401b30f53d1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.017956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.018530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.018808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.019078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.077222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.079410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91575-f7e7-421f-8f5b-581a62443934 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.120494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.122098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.122933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.125123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.125414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.126531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.130167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.136766 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.139665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:46.159524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:46.160648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:46.161729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 331/655] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:46.162357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.248098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 325/656] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:46.253754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.282749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197544c6-be78-4874-a7b3-1018277348ef None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.321133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.321946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.322275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.322552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.331753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.333513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.341751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:46.351105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:46.353629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:55:46.356231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:46.357827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 332/657] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:46.358002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.366905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a359-445d-4265-91f6-5a905041a978 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.405466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.406429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.406784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.407057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.408115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:46.408734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.410469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.427017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.430903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 326/658] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:46.431753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.483972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294f90-6414-44fb-89ac-f50355dc09d3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.528958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.530072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.530414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.530823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.545650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.547420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-649a898a-4688-450a-be09-d2846f74b46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:46.570484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:46.571451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:46.572343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:46.572343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:46.572343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:46.572343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:46.572343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 333/659] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:46.581638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f0cc2-9cda-4f27-9cf6-0deff5d46459 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.581638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f0cc2-9cda-4f27-9cf6-0deff5d46459 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.581638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f0cc2-9cda-4f27-9cf6-0deff5d46459 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.581638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 334/660] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:46.581638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f0cc2-9cda-4f27-9cf6-0deff5d46459 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.661232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5693-0c9d-4fa4-ab13-802c2d4cd98b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.704564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.705292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.705579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.705857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.706697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:46.706792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f0cc2-9cda-4f27-9cf6-0deff5d46459 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.707009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.708479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f8f07-d5c1-4bbe-841c-105b1efbb5e1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.711496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.721139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.730551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 327/661] 10.222.0.31 () {56 vars in 1139 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:46.730551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.730551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.730551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.745659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:46.746980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:46.757303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.758018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.758301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.758578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.820521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 328/662] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:46.821763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.847760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.849261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.932245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811289d-07d0-4099-86fb-aa187296bfef None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:46.955595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.959541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 335/663] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:46.961789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:46.971286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:46.971950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:46.972230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:46.972501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:46.973245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:46.973548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:46.974386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:46.974900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:46.992598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 329/664] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:46.992598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.075455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12884-ef86-4d64-8299-04e943e96e3b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.109304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869f987-d49c-4680-b856-57b2edd68d25 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.116505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.117193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.117475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.117748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.153595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.154395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.155236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.155798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.167160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:47.175890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:47.176878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:47.178182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 330/665] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:47.179132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.200738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.203368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.215310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.229079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.290722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff594be-0fc6-47a7-b221-e5bfda01fced None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.314920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 336/666] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:47.315775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.337119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.337845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.338137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.338822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.351225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.352700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:47.370824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:47.371745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:47.372649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:47.372649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:47.372649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:47.372649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:47.372649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 331/667] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:47.372989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.433347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6b81-9856-4bcc-b0a5-a2594a091dcb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.445564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.473901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.480343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7cacc-6df3-48da-9e10-aad79c9349e0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.481401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44295e38-c883-4282-992b-d61db869f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.482468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44295e38-c883-4282-992b-d61db869f774 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.484236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44295e38-c883-4282-992b-d61db869f774 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.484516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44295e38-c883-4282-992b-d61db869f774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.493163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44295e38-c883-4282-992b-d61db869f774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.494880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44295e38-c883-4282-992b-d61db869f774 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-44295e38-c883-4282-992b-d61db869f774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:47.510145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:47.511083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:47.511960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:47.517119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 337/668] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:47.517972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44295e38-c883-4282-992b-d61db869f774 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.518919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.519591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.519883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.520163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.520964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:47.521276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.522672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.532549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 332/669] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:47.533404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.631814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44295e38-c883-4282-992b-d61db869f774 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.638422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e80c2-d9bb-4a44-a9db-0afc27a8c86d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.667811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.668743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.669133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.669420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.679970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.681087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.681087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.681452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.682260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:47.682645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.683290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.684158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.684904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.703156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 333/670] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:47.703156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:47.705852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:47.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:47.707810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:47.707810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:47.707810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:47.707810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:47.707810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 338/671] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:47.708216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.728733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.732616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.822801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c023-13a9-461c-8c64-f50bf73886d8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.823007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a315d-218a-4662-a13a-48ab39cc5d2d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.862969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.863918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.864262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.864598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.866432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.867099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.867381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.867647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.868434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:47.868903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.870341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.878740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.880568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.888389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 334/672] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:47.888389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:47.905087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:47.906069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:47.907109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:47.907109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:47.907109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:47.907109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:47.909044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 339/673] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:47.910129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.986489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.997263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.012524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d041224-28d5-4681-a7ef-dc10cfcf738e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.040267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b057cd8-e8f7-4b5e-bfd8-15d5241be5cb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.062670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.063481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.063768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.064038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.071846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.073150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.084338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.085308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.085771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.086215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.087132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:48.087632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.089211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:48.092165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:48.093996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:48.095022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:48.099037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 335/674] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:48.099900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.107300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 340/675] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:48.109492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.232104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb739b-e028-474f-9d8e-6566dd853f7d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.246324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd73bf-1eb7-4a12-a003-4c7327b76d6b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.275561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.276344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.276718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.277068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.278079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=ca966a266e17460b8e38790f506eb406) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:48.278485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.280333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.286007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.292758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 336/676] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/role_assignments?user.id=ca966a266e17460b8e38790f506eb406&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:48.292758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.297126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.302239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.303064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.303399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.303717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.305352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:48.305673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.307368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.330293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 341/677] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:48.330293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.449022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c490f22-78f9-4c04-8d04-fc6aba08209e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.478259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14408d4-e466-4b6e-86d5-57f53396feea None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.494290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.494914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.495714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.495714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.496218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:48.496712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.498251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a59a7-c7d8-4390-a6a9-3bc9742bad00 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.514600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 337/678] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:48.516238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50e6c4-17b6-40f0-897a-73e45aec32b8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.516532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50e6c4-17b6-40f0-897a-73e45aec32b8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.516865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50e6c4-17b6-40f0-897a-73e45aec32b8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.518097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 338/679] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:48.518793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50e6c4-17b6-40f0-897a-73e45aec32b8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.527214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.528105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.528447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.528775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.541544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.543944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:48.559050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:48.560246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 342/680] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:48.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.597260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.634997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.648606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50e6c4-17b6-40f0-897a-73e45aec32b8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.692706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.693645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.694032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.694533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.703977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.705541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.712498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a153a2-3166-40d6-848e-f63e06f7205b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-995910ee-88bc-4cbb-9415-5c83f81a8fa2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:48.722068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:48.723329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:48.724453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:48.729690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 339/681] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:48.731036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.731328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.731609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.750910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:48.752078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:48.757809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.758492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.758971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.759456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.760549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=600d472e73da4c96af486c16a3f7df81) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:48.760900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.763083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:48.780728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 343/682] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/role_assignments?user.id=600d472e73da4c96af486c16a3f7df81&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:48.780728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.862075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 340/683] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:48.862987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:48.934910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc38a-3c78-42f0-b14c-9b448f751672 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:48.955948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.969438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:48.980220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:48.981088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:48.981478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:48.981993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:48.983452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:48.983847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:48.985844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.002821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 344/684] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:49.003624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:49.030126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb447c-5f18-455d-adad-18687e3eb7ca None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.087447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.088131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.088416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.088725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:49.089978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:49.089978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:49.091284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.119150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 341/685] 10.222.0.31 () {56 vars in 1135 bytes} [Wed May 25 16:55:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:49.120349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:49.136325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d8b8d-fad3-4de5-8776-e24ef7ed02cd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.186353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.188364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.188994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.189482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:49.206758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:49.208616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:49.233000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:49.233988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:49.234876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:49.234876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:49.234876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:49.234876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:49.237453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 345/686] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:49.238936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:49.242025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92fed-b2a3-42b2-b2ad-3590022d38c7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.257284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:49.278405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:49.288437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.289357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.289834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.290254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:49.291281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=722c501d471d402b9b7eb5879b103ec7) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:49.291799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:49.293997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.304072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 342/687] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:49 2022] GET /identity/v3/role_assignments?user.id=722c501d471d402b9b7eb5879b103ec7&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:49.305265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:49.436591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc48023-6979-4cb1-9129-05d34a5dedad None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.482116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.484001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.484477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.485638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:49.486699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:49.487266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:49.489161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.495025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a91ce-6862-481d-a53d-276c12b01568 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.506254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 343/688] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:49.514791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:49.583064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.583815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.584133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.584471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:49.592366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:49.672372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:49.672982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8a8a-58f3-4464-90e6-05d1ed389269 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.674113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.709496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:49.716384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.717566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.718140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.718670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:49.719590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:49.721313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:49.744895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 344/689] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:55:49 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:49.807315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 346/690] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:49.813850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:49.922926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:49.939062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f804f5-5b49-45ff-80f3-4f2ada59c588 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:49.991657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:49.992475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:49.992795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:49.993148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:50.004587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:50.006074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:50.024287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:50.025244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:50.026142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:50.026142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:50.026142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:50.026142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:50.026142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 345/691] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:50.033244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:50.140622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca06c4-0337-4542-935b-f92cabb59c20 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:50.169189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:50.183225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:50.183902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:50.184187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:50.184463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:50.185245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:50.185558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:50.187399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:50.201836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 347/692] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:50.207719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:50.329819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fc7a-2161-4358-ba86-288cdd52075c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:50.367568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:50.368754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:50.369268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:50.369748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:50.377517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:50.379264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:50.394792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:50.395693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:50.396588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:50.399037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 346/693] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:50.405725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:50.549922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0b9a2-dd92-41d8-b141-44efa0352157 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:50.601894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:50.602938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:50.603429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:50.604056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:50.605100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:50.605619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:50.607287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65d70-fcc9-48d5-9dd0-09ae19403532 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:50.629306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 348/694] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:50.635436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:50.638575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:50.759275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b663d-d489-4048-ab9b-8435101266e6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:50.804203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:50.805022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:50.805360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:50.805689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:50.806733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=a7d82cb54434427d816780c435562667) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:50.807065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:50.808775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b508a15-1349-4644-8069-ca7e9194274e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:50.822498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 347/695] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:50 2022] GET /identity/v3/role_assignments?user.id=a7d82cb54434427d816780c435562667&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:51.233300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6dc3-6371-477b-b522-f7cf7ccb0ca7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.233841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6dc3-6371-477b-b522-f7cf7ccb0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.233949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6dc3-6371-477b-b522-f7cf7ccb0ca7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.235562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 349/696] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:51.240986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec73d-b851-4424-8d61-a9e99625de59 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.241280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec73d-b851-4424-8d61-a9e99625de59 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.241560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec73d-b851-4424-8d61-a9e99625de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.259958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2b1ec73d-b851-4424-8d61-a9e99625de59 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:51.261184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2b1ec73d-b851-4424-8d61-a9e99625de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:51.328943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:51.337146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 348/697] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:51.360790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6dc3-6371-477b-b522-f7cf7ccb0ca7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:51.380397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e114d-7900-4579-a543-108928237b31 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.380766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e114d-7900-4579-a543-108928237b31 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.380980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e114d-7900-4579-a543-108928237b31 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.382592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 349/698] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:51.392665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.393028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.393264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.422488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:51.424779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:51.425794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:51.486900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6dc3-6371-477b-b522-f7cf7ccb0ca7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:51.518285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 350/699] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:51.533554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:51.534373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.534659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.534934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.535649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:51.537258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:51.544722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:51.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:51.556623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:51.557805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 350/700] 10.222.0.31 () {56 vars in 1129 bytes} [Wed May 25 16:55:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:51.566584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:51.655516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6667d60-0e6f-47e3-ab4e-6a38a13b003f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:51.686323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df088c-407c-4bd2-a194-a5e8a4bc946a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:51.694966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:51.703810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:51.719526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:51.723666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.724179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.724659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.749244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:51.758653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:51.759552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:51.760076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:51.760547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:51.761480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:51.761996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:51.763544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:51.766185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:51.767091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:51.767926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:51.772339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 351/701] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:51.775985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 351/702] 10.222.0.31 () {56 vars in 1124 bytes} [Wed May 25 16:55:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:55:51.782077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:51.783148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:51.964008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975822-5515-4d96-855f-2ea4af1d9e67 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:51.969526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbfd58-0707-40c1-936c-d3abae86efff None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:52.024310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:52.025425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.025940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.026367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.027291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:52.027759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:52.030074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:52.030217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:52.030925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.031212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.031492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.032205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:52.032552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:52.033919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:52.040735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 352/703] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:52.045777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 352/704] 10.222.0.31 () {56 vars in 1124 bytes} [Wed May 25 16:55:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:52.046970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:52.131929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:52.215791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92598da-a7b0-4fed-9999-08aa5554767e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:52.262866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:52.263743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.264533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.264835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.283139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:52.284529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:52.310100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:52.311616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:52.312813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:52.312813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:52.312813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:52.312813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:52.312813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 353/705] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:52.318534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:52.369776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:52.439565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df667a-e40c-4f1f-be7f-17be60def84c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:52.487433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:52.488106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.488389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.488663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.489419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:52.489724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:52.491090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4d43d-f498-499a-ae7d-7aa53a64082e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:52.505305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 353/706] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:52.511375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:52.572058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc30a-93d0-4982-a8d6-128c3da4d5eb None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.572404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc30a-93d0-4982-a8d6-128c3da4d5eb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.572622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc30a-93d0-4982-a8d6-128c3da4d5eb None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.574123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 354/707] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:55:52.579689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936d14-22c9-497a-a548-0da93fedf2a7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.580230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936d14-22c9-497a-a548-0da93fedf2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.580743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936d14-22c9-497a-a548-0da93fedf2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.598639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6f936d14-22c9-497a-a548-0da93fedf2a7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:52.600240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6f936d14-22c9-497a-a548-0da93fedf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:52.712003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:52.715315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a5ab9-5127-4c8c-91c2-800b656c5a86 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:52.731614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 355/708] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:55:52.752788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e4fc-5daf-4e92-9281-033ad3c9d64b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.753096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:52.753239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e4fc-5daf-4e92-9281-033ad3c9d64b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.753449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e4fc-5daf-4e92-9281-033ad3c9d64b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.753858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.754296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.754398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.755364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 356/709] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:55:52.756287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e4fc-5daf-4e92-9281-033ad3c9d64b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:52.763157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:52.765683 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-6317e9e0-042f-4ee5-8598-89b18bef20f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:52.782017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:52.782988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:52.783914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 354/710] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:55:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:52.785180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.785180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.785555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.791748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:52.805612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:52.806813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:52.868980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e4fc-5daf-4e92-9281-033ad3c9d64b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:52.884537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 355/711] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:52.885407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:52.936361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:52.937537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:52.937882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:52.938225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] PATH_INFO: `/v3/services/network` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:52.938949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:52.940392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:52.957727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:52.958755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:52.959605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 357/712] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:52 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:52.960421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:52.997339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.011692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f7f05-e39e-40fd-a4e5-ff4548c4be80 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.049179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.050188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.050689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.051138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.052142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:53.052626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.054288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.073536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 356/713] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:55:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:53.074739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.092298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f260-dd41-45f8-b076-4606c8399618 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.113063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.137365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.139321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.139872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.140406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.153094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:53.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:53.164457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:53.165448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:53.168791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 358/714] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:53.170114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.200708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67da0e-babf-46e7-9c6f-56fd305815d9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.245522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.246628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.247092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.247517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.249451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:53.250199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.251763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.258102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 357/715] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:53.259212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.278111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.294340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e733d75-f284-4b70-91e7-0a8d9bcea3e7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.337477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.338476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.338987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.339465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.370108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.385835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa93b6-badc-491d-b051-2570735b9ca2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.424586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.425620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.425844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.426325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.426820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.427295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.428006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:53.428516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.430414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.440802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 358/716] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:53.441977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.528083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.563684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3517f-4b5f-431b-a53c-2b372e6c196b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.564174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 359/717] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:53.565770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.607255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.609922 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.610440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.613092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.613961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:53.614279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.615682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.624727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 359/718] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:53.625602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.649094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.711652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eedf99-7a1d-42b6-8e10-fc4939b1de0a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.755082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.756053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.756442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.756872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.770283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.772413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:53.793668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:53.794633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:53.796159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:53.796159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:53.796159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:53.796159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:53.800715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 360/719] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:53.803272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:53.907670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb19fc-0b05-49b1-8351-b9f3429170c1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.946281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ecc42-fa10-4676-83c0-226d3edf7f6c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:53.955856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.968834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.969619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.969904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.970181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.978836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:53.988529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.990022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:53.994691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:53.995731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:53.996233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:53.996719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:53.997638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:53.998221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:53.999980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.017038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 361/720] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:54.019224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:54.019981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:54.020852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:54.021730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:54.021730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:54.021730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:54.021730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:54.021730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 360/721] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:54.030313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.132803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273e87-f429-4583-a002-0d553cf2d3ca None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.171006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.172250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.172786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.173259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.181910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.183645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.193643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f17b2-4e9b-4d08-9586-a712e370e595 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6d6faa30-3211-4f55-b114-d9eda9d305dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:54.200198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:54.201693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:55:54.202609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:54.206210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 362/722] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:54.207797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17517b-de47-415d-8936-89e865492d9e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.208283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17517b-de47-415d-8936-89e865492d9e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.208824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17517b-de47-415d-8936-89e865492d9e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.210475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 363/723] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:54.211478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17517b-de47-415d-8936-89e865492d9e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.242662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.243333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.243620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.243902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.244629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:54.244971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.245081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:54.246429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623884d-69a4-46ac-b37e-3c691f04eab1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.264063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 361/724] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:54.265439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.265735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.266019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.283827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:54.285145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:54.330138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17517b-de47-415d-8936-89e865492d9e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.336571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:54.359424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 362/725] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:54.360328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.370832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.371910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.372393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.373505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.374815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:54.375407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.377189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.397574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 364/726] 10.222.0.31 () {56 vars in 1149 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:54.403183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.467010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f311f-57e7-4582-94d3-5d48935428e7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.497356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:54.518084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.519071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.519454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.519825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.520164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b59b4-98b4-4498-8044-ba09130191a5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.529426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.531648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:54.552578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:54.553725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:54.554810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:54.557318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 363/727] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:54.558595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.563720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.564891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.565439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.565439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.577499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:54.586219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:54.587152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:54.587995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:54.592718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 365/728] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:54.593990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.618110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:54.700268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e014-d56c-4c1b-9789-c71187c64959 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.724948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6d02-247d-45c6-9bfe-e8ac2c59ebb0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.739586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e83ce-c897-4c89-83be-44508622a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.740443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e83ce-c897-4c89-83be-44508622a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.740931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e83ce-c897-4c89-83be-44508622a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.741209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e83ce-c897-4c89-83be-44508622a1b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.762568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.763229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.763527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.764775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.765563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:54.765878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.767324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.780630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 366/729] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:54.781472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.787168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:54.817426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e83ce-c897-4c89-83be-44508622a1b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.818879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e83ce-c897-4c89-83be-44508622a1b6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.858454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:54.890644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced148d-e73b-485a-91ea-6e2577ae5eec None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:54.918977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 364/730] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:54.925320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c8e8-1384-4b12-b58f-6ea422817a34 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.925609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c8e8-1384-4b12-b58f-6ea422817a34 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.925609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c8e8-1384-4b12-b58f-6ea422817a34 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.927174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 365/731] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:54.927864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c8e8-1384-4b12-b58f-6ea422817a34 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:54.932891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:54.933652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:54.933944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:54.934221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:54.934975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:54.935287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:54.937520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:54.946400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 367/732] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:54.947273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.020392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.050366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c8e8-1384-4b12-b58f-6ea422817a34 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.061635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c67ef-b06e-47ec-ba36-4c6a0973923b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.085929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.086595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.086879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.087155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.087997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=081f5d965327435dba6971aab789335e, user.id=600d472e73da4c96af486c16a3f7df81) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:55.088310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.089789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821fcc-b188-4168-885c-b0a114d7f683 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.095806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 366/733] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/role_assignments?user.id=600d472e73da4c96af486c16a3f7df81&scope.project.id=081f5d965327435dba6971aab789335e&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:55.097047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.097334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.097612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.103865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.113099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.114164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.114591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.114973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.119242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:55.120899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:55.129065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.130899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:55.154088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:55.155690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:55.156654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:55.156654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:55.156654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:55.156654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:55.156654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 368/734] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:55.158164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.201141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 367/735] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:55.202511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.313679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab5b5-7d70-4246-b6bb-19c9c097dc43 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.338977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.342189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9eeb7-fbee-45c9-a05b-d31376e58adf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.362576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.363624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.364060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.364513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.380526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.380983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.381284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.381563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.381836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.382557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:55.382861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.383417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.384279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.386043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.399686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 368/736] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:55.400491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:55.411198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:55.412159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:55.413105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:55.413105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:55.413105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:55.413105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:55.415831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 369/737] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:55.417223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.514627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0e55c-23bc-480b-907e-3dca68550517 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.553318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.554156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.554535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.554902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.555874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.557523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.559475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6dc2-39c2-4646-b542-993479dfc80b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.577517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 369/738] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:55:55 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:55.578609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.615305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.616853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.617313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.617824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.627017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.637020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.651078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:55.665883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:55.666871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:55.667754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:55.675554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 370/739] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:55.676957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.722112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac6d36-de1a-43d4-85ad-99bb0278dafe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.736147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.772163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.773220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.774436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.775112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.776858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:55.777493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.780379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.801624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 370/740] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:55.807349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:55.928887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8612b8-2d14-404e-8798-4c3ef852e7e8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:55.946375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:55.970628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:55.972068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:55.972763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:55.973135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:55.983011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:55.985395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:55.993769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824e87-4baa-46bb-bad6-611f8470fa4e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:56.006435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:56.007598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:55:56.008599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:56.009460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 371/741] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:56.018011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:56.063922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:56.064591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.064899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.065175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.065972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:56.066286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:56.067725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:56.095172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 371/742] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:56.101836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:56.214437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:56.227054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cfa8b-596b-46e2-9d67-81ec711088f1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:56.231120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8134da-af89-4a72-86a1-892a51fae93f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:56.271624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:56.273010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.273506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.274106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.275755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=5f8e29b225c249fbab929273e2f573d9) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:56.280712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:56.280712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:56.289207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 372/743] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:56 2022] GET /identity/v3/role_assignments?user.id=5f8e29b225c249fbab929273e2f573d9&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:56.292651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24684f0f-b110-4302-894c-46836432f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:56.293370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684f0f-b110-4302-894c-46836432f423 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.293659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684f0f-b110-4302-894c-46836432f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.293941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24684f0f-b110-4302-894c-46836432f423 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.295421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24684f0f-b110-4302-894c-46836432f423 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:56.295830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24684f0f-b110-4302-894c-46836432f423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:56.297375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24684f0f-b110-4302-894c-46836432f423 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:56.323672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 372/744] 10.222.0.31 () {56 vars in 1135 bytes} [Wed May 25 16:55:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:56.329766 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:56.428198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d490-30c9-4ac7-8e2f-4999a172898e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.429016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d490-30c9-4ac7-8e2f-4999a172898e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.429495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3d490-30c9-4ac7-8e2f-4999a172898e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.431406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 373/745] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:56.438044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.438653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.439128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.469715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:56.471245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:56.473685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6681396-01c4-4edc-acff-f4f041f3e7e3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:56.517898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:56.518752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.519155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.519643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.534474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:56.546931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:56.610559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:56.612040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:56.612616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 374/746] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:55:56.662351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:56.787067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 373/747] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:55:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:55:56.792882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:56.850743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc256c-0949-441a-adf4-c8d48772c7e6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:56.853492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:56.923674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:56.924747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.925136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33912d-b9e2-426b-900a-600bf60ba723 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:56.925446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.925941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.927094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:56.929550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:56.946122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 375/748] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:55:56 2022] POST /identity/v3/services => generated 240 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:55:56.980508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:56.981865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:56.982469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:56.982950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:56.995731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:56.998530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:57.018298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:57.019238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:57.020106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:57.020106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:57.020106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:57.020106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:57.022432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 374/749] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:57.030983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:57.059956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:57.149067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e68b-dadc-44bb-8919-083263470766 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:57.187878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:57.188553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:57.188861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:57.189129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:57.189855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:57.190156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:57.191529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:57.205618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 376/750] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:57.211333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:57.332410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:57.338238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d5965-1702-4f6c-aa34-ce8f6153067e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:57.380296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:57.381438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:57.381899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:57.382371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:57.392309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:57.394042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:55:57.416348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:57.417348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:55:57.418204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:57.421300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 375/751] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:55:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:57.426784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:57.541055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:57.566897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937f27c-cfe9-4eeb-8dfc-1b185ca54995 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:57.623448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:57.624269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:57.624459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:57.624767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:57.625569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:57.625884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:57.627425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167de7-e665-43c6-828a-e391247a67f4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:57.648125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 377/752] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:57.653716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:57.805856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4816e-7aa6-44d5-b286-cf09c1b877bc None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:57.806148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4816e-7aa6-44d5-b286-cf09c1b877bc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:57.806438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4816e-7aa6-44d5-b286-cf09c1b877bc None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:57.808054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 378/753] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:57.817751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:57.818046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:57.818332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:57.848157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1ab2d-a55e-42ad-93ad-8ca25e8f150e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:57.858453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:57.859673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:57.921513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:57.922519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:57.923008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:57.923484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:57.925258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=081f5d965327435dba6971aab789335e, user.id=a7d82cb54434427d816780c435562667) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:57.926801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:57.929690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:57.938735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 376/754] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:55:57 2022] GET /identity/v3/role_assignments?user.id=a7d82cb54434427d816780c435562667&scope.project.id=081f5d965327435dba6971aab789335e&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:57.974498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 379/755] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:55:58.023596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:58.058977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:58.180133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6224f6-6b0a-413d-bc99-7d6a8d6c4f4a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:58.223090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:58.223898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:58.224181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:58.224456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:58.241562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:58.249522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:58.250480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:55:58.251329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:58.255223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 377/756] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:58.256514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:58.384991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:58.426092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835817bc-e249-434b-89e5-d14bf93b91a0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:58.484098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:58.484719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:58.485011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:58.485292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:58.486057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:58.486368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:58.487754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21fcc4-6bc7-49dc-bd6c-fa4e9e27cc63 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:58.496779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 380/757] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:55:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:58.502983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:58.658430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:58.675060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df92e24-ba47-41eb-b681-3d371b30d0ff None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:58.675555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df92e24-ba47-41eb-b681-3d371b30d0ff None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:58.675665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df92e24-ba47-41eb-b681-3d371b30d0ff None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:58.679071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 381/758] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:58.689845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:58.690134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:58.690416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:58.696412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e1b-ac1d-4f04-987b-a6933a3ae436 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:58.718333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:58.719536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:58.759656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:58.760381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:58.760668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:58.761136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:58.774215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:58.775675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:58.795584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:58.796508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:58.797447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:58.797447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:58.797447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:58.797447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:58.800700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 378/759] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:58.809713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:58.833114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 382/760] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:55:58.861860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:58.991680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.013246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf4b71-8d49-4b35-9141-08ec7e85dc66 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.065558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f0225-313f-4412-8f13-b9cd509aa7f6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.082212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.082879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.083165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.083443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.084171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:59.084479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.085886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef192-b7ba-4994-9cb6-a0c95708803c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.097026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.112952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 379/761] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:59.114652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cdeb-d7d8-408a-9251-4c7e009a1b40 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.115139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cdeb-d7d8-408a-9251-4c7e009a1b40 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.115632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cdeb-d7d8-408a-9251-4c7e009a1b40 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.117673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 380/762] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:59.118806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cdeb-d7d8-408a-9251-4c7e009a1b40 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.132999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.133822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.134105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.134379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.135361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.137050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-642c076f-ce21-4189-91f2-63e1be601403 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:59.156803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:59.157789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:55:59.158635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:55:59.160823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 383/763] 10.222.0.31 () {56 vars in 1129 bytes} [Wed May 25 16:55:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:55:59.162272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.162797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.163442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.185370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:59.186584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:59.241291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cdeb-d7d8-408a-9251-4c7e009a1b40 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.268795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 384/764] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:55:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:55:59.268795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.301440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.302650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.303155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.303626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.313750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.315501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.332002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:55:59.335247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:59.336181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:55:59.337158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:59.339704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 381/765] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:59.346201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.381178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40269f7-12e0-4db7-b73c-2660c4a518fb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.407866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.422699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.423371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.423661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.424047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.424759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:59.425067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.426571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.436778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 385/766] 10.222.0.31 () {56 vars in 1124 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:59.436778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.463596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253a0b-a8dd-48e9-b827-4aa8d4e7587f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.500477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.501713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.502230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.502706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.514934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:55:59.523042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:59.523953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:55:59.524883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:59.527514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 382/767] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:59.528567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.543639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d7139-b0bd-4826-9f3f-5bdde8d54eb5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.569264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.583809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.584718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.584909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.585171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.586008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:59.586314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.587818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.616050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 386/768] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:59.616050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.644256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8a63-7283-4225-8d82-b3f766748a09 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.658757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.689680 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.690349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.690636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.690918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.691627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:59.691939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.693389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.704212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 383/769] 10.222.0.31 () {56 vars in 1124 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:59.705161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.732904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642ad16-d1e2-4731-b62f-abd3ffb5b16a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.773777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.775348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.775830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.776486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.777645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:59.778118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.780385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.792188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 387/770] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:59.793267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.819662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2c97-f6b8-4ec5-a6ee-d01805caeccb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.843252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.857586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.858381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.858663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.858934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.870072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.871511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:55:59.889851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:55:59.890758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:55:59.891639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:55:59.891639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:55:59.891639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:55:59.891639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:55:59.891639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 384/771] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:55:59.891917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:59.912244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84e361-3d47-49ac-84b1-3ed14f11dcd5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:59.924584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:59.950591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:59.951800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.952082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.952353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.953190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] RBAC: Adding query filter params (interface=public, service_id=ce6fa539f26745beab597b8bac98c7a6, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:55:59.953504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:59.955185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20aeb3-1c75-4883-ae71-dba8120b3f41 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:59.967575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 388/772] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/endpoints?service_id=ce6fa539f26745beab597b8bac98c7a6&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:55:59.967575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee150-d1c4-4e83-9bcd-e6340f01aec4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:59.967575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee150-d1c4-4e83-9bcd-e6340f01aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:59.967575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee150-d1c4-4e83-9bcd-e6340f01aec4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:59.968806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 389/773] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:55:59.969991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ee150-d1c4-4e83-9bcd-e6340f01aec4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.004027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad00bb-83a6-4744-acb0-272e71636ef4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.040071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.041519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.041954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.042232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.055156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.056583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:00.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:00.075337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:00.076246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:00.076246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:00.076246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:00.076246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:00.076246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 385/774] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:00.076553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.080969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ee150-d1c4-4e83-9bcd-e6340f01aec4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.089655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.120896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.121558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.121843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.122119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.123495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:00.124295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.125705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aefbd7-0ca3-44e2-99a8-8cbf05ff538a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.138002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 390/775] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:00.139433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.139726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.140007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.157523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:00.158720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:00.172128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.191948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6eb9a-189a-4c0d-bb84-f42d1aefa05d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.228393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.229182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.229466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.229743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.230439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.231855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.236162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 391/776] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:00.237090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.245979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 386/777] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:00.247144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.379183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.387404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368530-f49e-4945-aedf-089654abeb16 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.387644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56503e94-6705-447d-a74f-01f6efff8e18 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.428515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.429366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.429647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.429922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.430330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.431102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.431489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.431875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.432755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:00.433183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.434655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.438376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.439786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.447298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 392/778] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:00.448273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-21a35fda-d306-460a-ab2d-a09ec8ccaff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:00.455671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:00.456820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:00.457940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 387/779] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:00.458457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75290-7c02-45ef-8ee7-2e31c239ecba None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.458696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75290-7c02-45ef-8ee7-2e31c239ecba None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.458927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75290-7c02-45ef-8ee7-2e31c239ecba None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.460398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 388/780] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:00.461125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75290-7c02-45ef-8ee7-2e31c239ecba None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.471585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.560861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4db0a-6016-4d38-9c6f-4abdf538b472 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.580473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75290-7c02-45ef-8ee7-2e31c239ecba None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.599879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.600849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.601284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.601682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] PATH_INFO: `/v3/services/network` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.602421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.603802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.615730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:00.616415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:00.617520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:56:00.618337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:00.619112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.619112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.619112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.622564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 393/781] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:00.624266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.629172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.630757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.648646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2e9deab6-d065-4465-8894-ad2c29c50003 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:00.650326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:00.651446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:00.652529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:00.653117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 389/782] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:00.654075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.654371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.654669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.671929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:00.673169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:00.738724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.752288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea7327-e2c7-42c0-8fd0-f9f746259c96 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.760912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 390/783] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:00.761678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.792444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.793445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.794104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.794453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.795843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:00.796307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.797768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.814406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 394/784] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:00.815820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.876040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4aa47-ddb1-45f0-9350-ffc3513275e5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.904348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:00.911786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.912573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.912989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.913361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.914165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] RBAC: Adding query filter params (name=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:00.914593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.916069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.921515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 391/785] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:00.925450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7742c0-a2ed-4df2-9d1b-7e9dee076a9d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:00.926752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.963757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:00.964531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:00.964916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:00.965271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:00.966184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:00.966599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:00.968213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:00.988153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 395/786] 10.222.0.31 () {56 vars in 1149 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:00.989007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:00.995167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.040112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f10d6-1a9f-4485-af66-0559f7526536 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.076590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.077411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.077703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.077977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.088371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:01.096620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:01.097602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:01.098438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 392/787] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:01.099129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.110358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8702-f238-4077-a4bf-07ab8dee6d0c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.147726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.148648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.148958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.149235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/600d472e73da4c96af486c16a3f7df81/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.151430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=600d472e73da4c96af486c16a3f7df81, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.152933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.172297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.178547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 396/788] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:00 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/600d472e73da4c96af486c16a3f7df81/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:01.179321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.217713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24e8b9-7029-4cb1-94f9-e9024b65bdb4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.242586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.261377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.262188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.262611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.262986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.263977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] RBAC: Adding query filter params (type=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:01.264389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.266196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.276845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 393/789] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:01.276845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.321545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ff07-950c-40ba-a239-0432ceebe6c6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.364353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.365203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.365471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.365748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.379973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.380630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:01.404829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:01.405828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:01.406707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:01.406707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:01.406707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:01.406707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:01.409133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 397/790] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:01.410214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.425005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79c1d6-8ddb-4ef5-8277-af4172e5217c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.462906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.463572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.463856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.464127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.464900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:01.465204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.467245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.476924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 394/791] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:01.477812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.485056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.530623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673af61-4ad9-4b02-9906-08b0939940f7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.540450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.565993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.566733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.567025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.567364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.568173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] RBAC: Adding query filter params (interface=public, service_id=302727cba1754f01aca71c3f634bc005, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:01.568495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.570075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.580219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 398/792] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/endpoints?service_id=302727cba1754f01aca71c3f634bc005&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:01.581193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.603631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1114-9719-497f-a9a0-0ddf3ba067fe None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.639227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.639968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.640251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.640522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.641267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:01.641570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.642928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.656432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 395/793] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:01.657297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.708102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516b13b-a468-4e1e-b6e9-d17d33bf52e7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.726908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.754935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.755905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.756191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.756470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.770556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.772633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:01.796536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:01.797708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:01.799161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:01.799161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:01.799161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:01.799161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:01.799161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 399/794] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:01.799161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.799952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18f30-0619-4834-b988-09b1a08fa4b2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.809246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:01.846829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.847803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.848248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.848699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.849530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:01.851071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:01.860953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 396/795] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:01.862084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:01.927875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2512c-6d8f-45bd-99f9-287e4721e2b3 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:01.977908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:01.978743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:01.979028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:01.979303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:01.999860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.001390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:02.038313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:02.039268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:02.040152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:02.041106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 400/796] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:02.047138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.089325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17166-18a6-4234-9443-2c153f3d7a40 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:02.115368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:02.149950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:02.151161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.152058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.152839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.154231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:02.155140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.157389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.173714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 397/797] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:02.179744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.213797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eaeb9-0103-459b-bd54-9e3c5b04903c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:02.215716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:02.263710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:02.264743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.265220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.266267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.267253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:02.267873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.270417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.292716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 401/798] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:02.297708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.298956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac432-9d60-4d7a-9e8f-f4dd131f1d0a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:02.339879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:02.341086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.342152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.342635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.352362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.354563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:02.371678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:02.372745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:56:02.373683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:02.376575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 398/799] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:02.382870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.487293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:02.493961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:02.499001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e38ccd-02be-433a-a085-a349b1795675 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:02.535746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad4c62-3bd7-4f77-a1d5-e9b700e4620e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:02.542660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:02.547840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.548412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.548929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.549992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:02.550514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.552172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a93035-ccc5-4d69-8bf9-0fe0df88a050 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.592843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 399/800] 10.222.0.31 () {56 vars in 1135 bytes} [Wed May 25 16:56:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:02.595525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d0ad-f6de-40b3-b78a-cd88a58364bf None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.595525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d0ad-f6de-40b3-b78a-cd88a58364bf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.595525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d0ad-f6de-40b3-b78a-cd88a58364bf None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.597630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 400/801] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:02.598383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d0ad-f6de-40b3-b78a-cd88a58364bf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.611910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79cb4c-1975-4d2e-85f6-b4242d469669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:02.612850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79cb4c-1975-4d2e-85f6-b4242d469669 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.613131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79cb4c-1975-4d2e-85f6-b4242d469669 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.613403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79cb4c-1975-4d2e-85f6-b4242d469669 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/5f8e29b225c249fbab929273e2f573d9/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.632362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79cb4c-1975-4d2e-85f6-b4242d469669 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=5f8e29b225c249fbab929273e2f573d9, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.634044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79cb4c-1975-4d2e-85f6-b4242d469669 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.650386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 402/802] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:02 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/5f8e29b225c249fbab929273e2f573d9/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:02.656829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.656829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.656829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.690019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:02.693149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:02.813573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 403/803] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:02.838577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d0ad-f6de-40b3-b78a-cd88a58364bf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:02.846160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.878415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:02.879272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:02.879553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:02.879973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:02.892896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:02.894394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:02.913037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:02.913983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:02.915464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:02.915464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:02.915464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:02.915464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:02.915464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 401/804] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:02.921156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:02.922675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:02.946561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:02.987641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6792-4f9b-4849-a3b6-f55acc8b8cfb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.029486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.030332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.030614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.030924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.031612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.033107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.039400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804472d-6917-4060-94c2-c6af5b8140aa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:03.045872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:03.046814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:03.047835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 404/805] 10.222.0.31 () {56 vars in 1129 bytes} [Wed May 25 16:56:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:03.053293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:03.080033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.081072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.081616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.082032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.082939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:03.083384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.085018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.099045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 402/806] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:03.105727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:03.176544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:03.214489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf7b1-9e24-415a-81eb-bbe7e8a3fd06 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.225530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da76e-169a-42cd-b508-3ddd47922c81 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.264359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:03.272006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.272891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.273315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.273729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.274568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:03.275037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.276541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.283530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 405/807] 10.222.0.31 () {56 vars in 1124 bytes} [Wed May 25 16:56:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:03.291919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:03.299225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.300066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.300363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.300647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.318736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.320427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:03.338881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:03.340044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:03.341273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:03.345011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 403/808] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:03.346665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:03.507784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210eaca-b33e-471b-a964-6c9d905ec6ac None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.528394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d05a1-6b50-4ca2-8805-5298b80e4401 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.569068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:03.572247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.572959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.573243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.573519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.574228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:03.574536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.576895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.596935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.597530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.597817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.598095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.598896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:03.599207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.600645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.601630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 406/809] 10.222.0.31 () {56 vars in 1124 bytes} [Wed May 25 16:56:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:03.602558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:03.633017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 404/810] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:03.635571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:03.707348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:03.759940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0b102-c691-4f25-b5ae-4ed748ae5cbc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.783630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963e5f-9c19-4c61-b9a0-05c14b6c275c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:03.804784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0ad0a-00b7-41b4-afda-742e43143f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.805907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ad0a-00b7-41b4-afda-742e43143f3e None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.806267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ad0a-00b7-41b4-afda-742e43143f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.806616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0ad0a-00b7-41b4-afda-742e43143f3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.807497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0ad0a-00b7-41b4-afda-742e43143f3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.809540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0ad0a-00b7-41b4-afda-742e43143f3e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.823470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:03.825140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.825466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.826511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/a7d82cb54434427d816780c435562667/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.829344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=a7d82cb54434427d816780c435562667, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:03.830900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:03.848993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 407/811] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:03.848993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198753-f32b-4e67-9d9b-28b793676f7f None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.848993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198753-f32b-4e67-9d9b-28b793676f7f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.848993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef198753-f32b-4e67-9d9b-28b793676f7f None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.853404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 408/812] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:03.858653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 405/813] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:03 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/a7d82cb54434427d816780c435562667/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:03.859511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:03.859806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:03.860203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:03.880792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:03.882075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:03.972221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 409/814] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:03.997212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:04.067643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:04.152761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678d7e-c644-46b7-8d83-68ff9607e716 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:04.193787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:04.194599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:04.194885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:04.195160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:04.208508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:04.216867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:04.218083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:04.218936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:04.219574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 406/815] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:04.225042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:04.276521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:04.344322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae5a8-dd20-46b7-95b8-0f8cfdd9c643 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:04.380700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:04.381391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:04.381673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:04.381951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:04.382706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:04.383012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:04.384396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:04.393508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 410/816] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:04.401768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:04.521318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:04.525096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d263-f603-4ac5-ad3e-8bfd09049b74 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:04.561567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:04.562615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:04.562894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:04.563168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:04.574393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:04.576388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a01bdd3d-1c6a-4582-b56d-e3adc9a4a319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:04.598347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:04.599285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:04.600173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:04.600173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:04.600173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:04.600173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:04.600173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 407/817] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:04.605171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:04.678741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1beaa-a8e4-4bcb-8bca-891e1aa6c471 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:04.679088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1beaa-a8e4-4bcb-8bca-891e1aa6c471 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:04.679301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1beaa-a8e4-4bcb-8bca-891e1aa6c471 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:04.681966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 408/818] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:04.686568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:04.686854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:04.687399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:04.718607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:04.719820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:04.765580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc62a-58e8-4a26-80f4-bdb104656051 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:04.767685 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:04.819080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:04.819755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:04.820033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:04.820305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:04.821060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:04.821370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:04.822744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:04.847243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 411/819] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:04.852271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:04.852961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 409/820] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:04.888840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.033920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.038750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48128870-d75a-452a-8b50-cd6ec4ae4b5c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.063437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e5df8-8e64-4749-9c59-23f0d12983cf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.078663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.079383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.079663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.079935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.088147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.089761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:05.118237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:05.119214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:05.120165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 412/821] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:56:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:05.126120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.129644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.130433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.130708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.130975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.131620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.133016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:05.157792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:05.160138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:05.161260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 410/822] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:04 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:05.168173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.177090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.264485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c842877-07b3-4016-8c85-9d55c79edaa7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.313365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.314379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.314850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.315306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.316339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:05.316648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.318129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.351171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 413/823] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:05.352160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.353669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9744124-9552-4050-8bb4-b7e9612c71b9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.425974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.426658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.426941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.427214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.427946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] RBAC: Adding query filter params (name=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:05.428253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.429804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7308c-afae-4349-b86b-19a31efbad37 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.436046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 411/824] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:05.437708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c70833-f215-494c-a7ec-7f275474eb2f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.437996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c70833-f215-494c-a7ec-7f275474eb2f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.438270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c70833-f215-494c-a7ec-7f275474eb2f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.439714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 412/825] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:05.444621 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c70833-f215-494c-a7ec-7f275474eb2f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.457845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.474219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.497293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1bf14-cd9e-48c4-bad6-677aebd5ace6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.534339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.535300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.535797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.536265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.564468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c70833-f215-494c-a7ec-7f275474eb2f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.603632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.604214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.604499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.605160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.605638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] RBAC: Adding query filter params (type=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:05.605947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.608253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127362e-abbe-4ea3-8c5e-897c6e11447f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.613138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.614157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 413/826] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:05.615046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.615449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.615740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.616014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.634727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:05.635866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:05.717346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.717617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 414/827] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:05.718989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.722348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.735772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 414/828] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:05.741513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.845397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600356b-7457-49dc-b8b4-5fb831dfea4f None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.846665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587075-b519-4e98-bd0f-3733f03a960e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:05.881889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.883315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.883745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:05.884056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.884397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:05.884711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:05.884919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.885018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:05.885695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.887337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.896584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:05.898480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:05.910821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 415/829] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:05.912067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:05.920559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:05.921763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:05.922663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:05.922663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:05.922663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:05.922663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:05.922663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 415/830] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:05.927696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:05.962645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:05.991619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.040712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ec69-0157-4533-99f3-5017ef39905d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.050009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb15e8-46a4-4ada-9b63-245709459dd0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.080184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.080908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.081301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.081473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.082268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:06.082587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.084028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.097121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.097331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 416/831] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:06.098486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.098968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.099464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.102710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.113215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:06.121742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:06.122818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:56:06.123940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:06.126835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 416/832] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:56:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:06.133192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.204507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.216065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375aaa9-19c3-4529-89a4-ef921294e82d None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.253582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.254387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.254673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.254953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.255428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d6542-ccfe-45c7-a8dc-54f09ba6c713 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.262955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.265234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.275228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:06.281838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:06.282924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:06.283930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:06.285088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 417/833] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:06.290648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.299593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.300558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.301067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.301517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.302543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:06.303025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.304700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.314679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 417/834] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:06.320528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.399416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6311086-61b0-4c4e-9b55-bc1ba104736e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.436354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f48f-7c26-478d-abc0-1975bde15a1e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.448263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.449796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.450261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.450818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.451795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:06.452474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.454871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.472704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 418/835] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:06.478378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.484602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.485434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.485712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.485979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.497061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.499662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.502234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:06.526332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:06.527303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:06.528190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:06.528190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:06.528190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:06.528190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:06.528190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 418/836] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:06.535955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.581317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.627669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743d4d-2087-4ecc-9ef8-5a87eb38cf9a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.668357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.668987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.670027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.670693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.671808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=081f5d965327435dba6971aab789335e, user.id=600d472e73da4c96af486c16a3f7df81) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:06.672140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.675469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.675591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc63d1-00da-4a6b-a516-c6a768267c17 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.681719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 419/837] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/role_assignments?user.id=600d472e73da4c96af486c16a3f7df81&scope.project.id=081f5d965327435dba6971aab789335e&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:06.724166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.724877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.725172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.725442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.726271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:06.726582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.727997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46b0f1-4d41-4e39-9c12-f0ff4f6fb086 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.743282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 419/838] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:06.748463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.750132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f6c3-76e9-43d0-bac5-0e46d9079782 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.750485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f6c3-76e9-43d0-bac5-0e46d9079782 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.750824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f6c3-76e9-43d0-bac5-0e46d9079782 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.756637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 420/839] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:56:06.758477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35a83-2247-4cff-adfa-0164d8ffe365 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.758763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35a83-2247-4cff-adfa-0164d8ffe365 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.759036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35a83-2247-4cff-adfa-0164d8ffe365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.777091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e5f35a83-2247-4cff-adfa-0164d8ffe365 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:06.778311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e5f35a83-2247-4cff-adfa-0164d8ffe365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:06.849091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.863379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3efc-7ce2-4c55-959c-22ab52c814c6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:06.873437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 421/840] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:06.880467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a361a-c867-40f5-ada1-fd95253a6f1c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.880845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a361a-c867-40f5-ada1-fd95253a6f1c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.881078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a361a-c867-40f5-ada1-fd95253a6f1c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.882713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 422/841] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:56:06.888806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.889195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.889362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.909708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:06.911277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:06.913148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:06.913960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:06.914248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:06.914524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:06.923184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:06.924557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:06.927737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:06.940863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:06.941894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:06.942808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 420/842] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:06.943402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:06.989542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 423/843] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:06.993174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915443-f246-4e36-9dce-5c9e96654fca None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.100694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.101907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.102576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.103059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.104120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.106121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.109273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ce9be-3124-457d-b1a0-e1a86f91449c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.110246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:07.121211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:07.122207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:07.123811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 421/844] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:07.124599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.151284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.151979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.152228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.152501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.153361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:07.153693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.155149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.176561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 424/845] 10.222.0.31 () {56 vars in 1149 bytes} [Wed May 25 16:56:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:07.176561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.185720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.242360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662151-91f0-49ef-81f7-939c96a58fa4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.280501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.281322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.281600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.282119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.285104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8e613-710c-4f44-86b3-3d710cc07391 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.292311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:07.299898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:07.300869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:07.301705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:07.306037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 422/846] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:07.306859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.324610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.325298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.326263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.326530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.327485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:07.327797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.329194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.338701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 425/847] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:07.339530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.367220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.410863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.411205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84493982-4c7c-4368-977f-5a4709caf747 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.443893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e132b7-c4b1-4f8d-aba3-49b3fa2c4b69 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.455432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.456091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.456378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.456654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.479896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.480871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.481329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.482298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.483211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:07.483717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.485179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.498611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 426/848] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:07.498611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.531345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.533097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.594795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.603214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b949e-376b-49fe-90b3-3d461a7c3f01 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.638231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.639015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.639294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.639565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.640255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:07.645053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.645184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 423/849] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:07.645184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.645346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.646059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.661042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 427/850] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:07.661944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.762583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36521a-5362-4cda-8079-ea5e85ee1607 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.802542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.803629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.804065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.804489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.812791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2b74f-4e5b-48a2-92af-83eaf23cbe3a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.817941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.819824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:07.840519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:07.842090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:07.843194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:07.843194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:07.843194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:07.843194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:07.845045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 424/851] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:07.850547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.855538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:07.856337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:07.856616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:07.857225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:07.867007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:07.872018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:07.874070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:07.895130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:07.896101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:07.897515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:07.897515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:07.897515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:07.897515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:07.897515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 428/852] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:07.902116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:07.963728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae37c-2790-4425-9e8e-e6681af8de92 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:07.970638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.007594 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.008262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.008540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.008844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.009562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:08.009868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.011255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.023403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 425/853] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:08.028274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.039477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2995f-2beb-485c-a480-99ca2a5b5016 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.076947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.078163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.078163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.078378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.078953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:08.079338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.080742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.098428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 429/854] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:08.099810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.124186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.160375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9ed94-1cd3-4704-9a61-7b744a24c478 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.198452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.199054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.199335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.199606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.210890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.212501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.226070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e4c9-d9f5-4e6a-9b26-9dfeca1108b3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:08.228047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:08.229017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:08.229935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 426/855] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:08.237637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.249239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.271110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.271906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.272190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.272463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.280289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.281711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:08.295743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:08.297083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:08.298409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:08.301997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 430/856] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:08.302857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.374079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad21d-b19c-4d91-9858-83b3a9c9d005 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.411738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5de4d2-c183-4be7-ba44-90c854d79111 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.412929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.421991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.422888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.423769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.424194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.425611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:08.426066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.428161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.453137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 427/857] 10.222.0.31 () {56 vars in 1135 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:08.455774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.458097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.459235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.460549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.461059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.462034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:08.462575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.464239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.484527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 431/858] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:08.490283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.530421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.579580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3474-960f-4042-8590-81fe4b855ec1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.609937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d6f3c-9c8d-4161-b220-8b54b72c9e4d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:08.617862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e81fca-bff8-4056-857d-66c42c28efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.619261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81fca-bff8-4056-857d-66c42c28efb7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.619444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81fca-bff8-4056-857d-66c42c28efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.619894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81fca-bff8-4056-857d-66c42c28efb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.650109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:08.651216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:08.651719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:08.652192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:08.653326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=5f8e29b225c249fbab929273e2f573d9) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:08.654561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.656186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.663615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 432/859] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/role_assignments?user.id=5f8e29b225c249fbab929273e2f573d9&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:08.709377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.722770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e81fca-bff8-4056-857d-66c42c28efb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:08.724707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e81fca-bff8-4056-857d-66c42c28efb7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:08.857333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 428/860] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:56:08.863700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:08.973221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:08.980273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d80f4b-7adc-4470-840a-a5ead471e016 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.021134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.022254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.022797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.023246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.025379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d659e-d204-4cfe-a843-d98933b456fe None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.025846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d659e-d204-4cfe-a843-d98933b456fe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.025933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d659e-d204-4cfe-a843-d98933b456fe None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.027274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 429/861] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:09.032919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.033205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.033479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.036060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.037800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.051736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:09.052966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:09.057940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:09.058884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:09.059743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:09.059743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:09.059743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:09.059743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:09.059743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 433/862] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:09.066206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.129917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 430/863] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:09.152177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.176690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:09.189340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c016-5eb5-49e3-b335-6d9db63907fd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.232921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.233740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.234130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.234529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.235362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:09.235773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.237802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.254844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 434/864] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:09.259694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.267131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2250-340f-43a8-ade5-94c76ebefd19 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.277058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:09.303675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.304502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.304816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.305091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.305747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.307122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:09.320668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:09.321670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:09.322487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:09.327148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 431/865] 10.222.0.31 () {56 vars in 1132 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:09.328206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.387387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3304c-6078-4f5d-8a85-0eeb0ec0ce71 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.425056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:09.431130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.431949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.432235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.432515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.442818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.444533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.445636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94d162-f34e-453c-b32a-06df8b54bfdb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:09.462490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:09.463422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:09.464280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:09.468568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 435/866] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:09.469449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.496604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.498960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.499458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.499945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.500899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:09.501423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.503014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.510393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 432/867] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:09.518759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.551551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:09.594417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c17c22-540a-47dc-a030-dca8e891e597 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.636638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.637898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.639092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.639683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.640806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:09.641336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.642989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.643307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4f4ea-2a0b-422d-88dd-5fb8e2cfe614 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.661559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 436/868] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:09.667435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:09.692876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.693581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.693855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.694144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.694868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:09.695176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.696912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c47a21-b219-4eda-9570-bb4635d2bf16 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.704858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 433/869] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:09.802228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4a6d-0425-4dc8-b1f4-d102911ead47 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:09.832697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:09.842951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:09.844276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:09.844986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:09.845270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:09.846145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=081f5d965327435dba6971aab789335e, user.id=a7d82cb54434427d816780c435562667) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:09.846744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:09.848741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a910-b3b2-4d40-bceb-65fee9fa9401 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:09.856226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 437/870] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:09 2022] GET /identity/v3/role_assignments?user.id=a7d82cb54434427d816780c435562667&scope.project.id=081f5d965327435dba6971aab789335e&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:10.050592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4478-efb5-43e0-b17e-cb93cf7f6983 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:10.051083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4478-efb5-43e0-b17e-cb93cf7f6983 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:10.051083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4478-efb5-43e0-b17e-cb93cf7f6983 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:10.052513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 434/871] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:10.057938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db596fb-9561-4bf7-b0a8-c8dee63863d7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:10.058231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db596fb-9561-4bf7-b0a8-c8dee63863d7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:10.058511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db596fb-9561-4bf7-b0a8-c8dee63863d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:10.076809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0db596fb-9561-4bf7-b0a8-c8dee63863d7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:10.078014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0db596fb-9561-4bf7-b0a8-c8dee63863d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:10.152803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 438/872] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:10.171839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4478-efb5-43e0-b17e-cb93cf7f6983 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:10.188326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:10.281592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4478-efb5-43e0-b17e-cb93cf7f6983 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:10.316848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95643-d47e-47b7-8758-01a8b86dca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:10.317521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95643-d47e-47b7-8758-01a8b86dca9d None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:10.317806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95643-d47e-47b7-8758-01a8b86dca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:10.318083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95643-d47e-47b7-8758-01a8b86dca9d None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:10.318820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c95643-d47e-47b7-8758-01a8b86dca9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:10.320202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c95643-d47e-47b7-8758-01a8b86dca9d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:10.335667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 435/873] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:10 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:11.121753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31bd3-d21a-4d93-ac7e-635c415ffa07 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:11.122849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31bd3-d21a-4d93-ac7e-635c415ffa07 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:11.122849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31bd3-d21a-4d93-ac7e-635c415ffa07 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:11.124338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 439/874] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:11.129840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:11.130697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:11.131195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:11.148798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:11.150291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:11.220460 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:11.228017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 436/875] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:11.252478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31bd3-d21a-4d93-ac7e-635c415ffa07 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:11.360168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31bd3-d21a-4d93-ac7e-635c415ffa07 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:11.381424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:11.395861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:11.396704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:11.397422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:11.397701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:11.408341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:11.417328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:11.418320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:11.419825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 440/876] 10.222.0.31 () {56 vars in 1120 bytes} [Wed May 25 16:56:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:11.425002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:11.534421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dcb04-9cc5-4b8f-b31e-1a3f0c24190e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:11.575126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:11.576726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:11.577427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:11.578005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:11.578990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:11.579500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:11.581139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:11.590636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 437/877] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:56:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:11.599025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:11.704393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b076b-46eb-4283-9fcf-4e9832dba401 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:11.740949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:11.741758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:11.742047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:11.742329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:11.753295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:11.754946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:11.772396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:11.773362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:11.774241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:11.774241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:11.774241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:11.774241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:11.774241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 441/878] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:11.779856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:11.847664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:11.896483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34fed-e533-47e9-a1d2-8bf284927a31 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:11.935915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:11.936517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:11.936834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:11.937481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:11.938216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:11.938523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:11.939901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce57c93-dc7f-481c-93fe-8f5f9203855c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:11.953898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 438/879] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:11.959264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:11.991787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.067985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab90e-1f97-4b44-aa72-fa3a59736557 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.096302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb96d2-cf24-44d1-833e-ec487fbf6197 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.096545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb96d2-cf24-44d1-833e-ec487fbf6197 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.096863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb96d2-cf24-44d1-833e-ec487fbf6197 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.098574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 439/880] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:12.104867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.105200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.105308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.105413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.106008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.106294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.106575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.116753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.118263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.123678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:12.124924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:12.134701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:12.136062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:12.137564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 442/881] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:56:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:12.143263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:12.213058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 440/882] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:12.228236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:12.256127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.270815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81da5-6e7c-436f-b6c6-723095df6aba None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.289062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.321905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.322589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.322932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.323155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.324119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:12.324430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.326290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728c378-12e4-4ce6-a59f-9cbc5da1faa9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.345882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a1f6d-8a39-49b0-85c4-eb4c1729ad7f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.351235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 443/883] 10.222.0.31 () {56 vars in 1149 bytes} [Wed May 25 16:56:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:12.351235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e54e6-cfee-4ba7-8012-b374aa10913d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.351235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e54e6-cfee-4ba7-8012-b374aa10913d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.351235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e54e6-cfee-4ba7-8012-b374aa10913d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.351235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 444/884] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:12.355599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e54e6-cfee-4ba7-8012-b374aa10913d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:12.391597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd262a-569c-4edf-a57c-838c7133697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.392260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd262a-569c-4edf-a57c-838c7133697c None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.392542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd262a-569c-4edf-a57c-838c7133697c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.393532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd262a-569c-4edf-a57c-838c7133697c None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.393532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd262a-569c-4edf-a57c-838c7133697c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.394924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd262a-569c-4edf-a57c-838c7133697c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.410722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 441/885] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:12 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:56:12.412284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.412826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.413315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.432292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:12.433973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:12.495089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e54e6-cfee-4ba7-8012-b374aa10913d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.539884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e55707-e617-4786-aa08-bc884da12a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.540815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 442/886] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:12.548886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55707-e617-4786-aa08-bc884da12a29 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.552724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55707-e617-4786-aa08-bc884da12a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.552724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55707-e617-4786-aa08-bc884da12a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.568713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:12.572142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.632785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.640461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e55707-e617-4786-aa08-bc884da12a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.642431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e55707-e617-4786-aa08-bc884da12a29 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.706049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729633-88f7-4e39-8fdd-4ad24a9f8995 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.743091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.743897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.744179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.744459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.745335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.746641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.757018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 445/887] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:12 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:12.758620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341288-6286-456c-8eef-997fc579968f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.759082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341288-6286-456c-8eef-997fc579968f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:12.759402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:12.760402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:12.761295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 443/888] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:12.762643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341288-6286-456c-8eef-997fc579968f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.764624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 446/889] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:12.766396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:12.768518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341288-6286-456c-8eef-997fc579968f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:12.827849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.883645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4320-3163-458c-adad-2d2dac33e560 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.885978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:12.888932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341288-6286-456c-8eef-997fc579968f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:12.920055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.920885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.921170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.921443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.927372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:12.928034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.928313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.928585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.929318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:12.929625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.930982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b1a61-6ff9-4e49-bbe0-65cabc322541 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.932999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:12.934435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:12.936411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 447/890] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:12.938096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:12.938380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:12.938657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:12.957317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:12.957925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:12.958773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:12.959655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:12.959655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:12.959655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:12.959655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:12.959868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:12.959937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 444/891] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:12.960427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.040907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 448/892] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:13.041687 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.085623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:13.090168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a256ab-6477-41de-ad56-ff85cad2483a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.128472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.129163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.129444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.129712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.130418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.130938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.133695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.148706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 445/893] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:13.148706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.160813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639b437-f7d3-4b55-9e54-af4afde602f7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.182467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:13.209322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.210612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.211215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.211816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.213216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.213424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.215058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.233700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 449/894] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:13.235711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.298628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3bc92-fefb-4fea-b530-21848e563737 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.338756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.339563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.339852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.340132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.340828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.342528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:13.355711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:13.356865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:13.357808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:13.358537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 446/895] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:13.364157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.375242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:13.379245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c7567-48da-4ed1-8d88-917fbff3db00 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.427982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.429199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.430229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.430857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.441956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.443764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:13.466288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:13.467229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:13.468103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:13.469467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:13.470290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 450/896] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:13.475726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.494567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a52a0-d241-4398-8cb7-c875509d03f4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.538156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.538840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.539129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.539418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.540421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.540762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.542327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.552823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 447/897] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:13.555095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.613376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b74e-981d-4adb-a016-697423810818 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.651710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.652378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.652658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.652958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.653862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.654154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.655936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.676067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 451/898] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:13.677082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.679719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a671582-dce7-44d7-b1b4-dc51f71faa5e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.702889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:13.718957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.719532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.719917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.720300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.721158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.721571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.723049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.733010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 448/899] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:13.735021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:13.752209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:13.790672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7127-cf16-4644-beb9-74c615ce0a59 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.827277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.828186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.828623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.829165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.830262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] RBAC: Adding query filter params (role.id=82a2c22eda6f461e8c6db80c8c417c94, scope.project.id=081f5d965327435dba6971aab789335e, user.id=5f8e29b225c249fbab929273e2f573d9) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.830756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.832360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.844990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 452/900] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/role_assignments?user.id=5f8e29b225c249fbab929273e2f573d9&scope.project.id=081f5d965327435dba6971aab789335e&role.id=82a2c22eda6f461e8c6db80c8c417c94 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:13.846356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1bdfb-3bb5-4715-ac8a-92c3a999e41b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:13.886210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:13.886884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:13.887168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:13.887446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:13.888478 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] RBAC: Adding query filter params (interface=public, service_id=414bcba3f1384bffaf7a8a6b15a61545, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:13.888828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:13.890229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb8ff8-d327-4691-a413-459df635e95a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:13.896411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 449/901] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/endpoints?service_id=414bcba3f1384bffaf7a8a6b15a61545&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:13.902134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:14.007166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:14.030488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a97a2-0fc8-4686-b52a-485375bd4ffa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:14.066480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858408c-8f4a-4e53-a8c0-18a5014c8c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:14.067146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858408c-8f4a-4e53-a8c0-18a5014c8c8a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:14.067436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858408c-8f4a-4e53-a8c0-18a5014c8c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:14.067717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858408c-8f4a-4e53-a8c0-18a5014c8c8a None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:14.068398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858408c-8f4a-4e53-a8c0-18a5014c8c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:14.069794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858408c-8f4a-4e53-a8c0-18a5014c8c8a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:14.076271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 453/902] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:13 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:56:14.754327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6bc54-d2f0-4646-bf9a-891e68ebbbb9 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:14.754841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6bc54-d2f0-4646-bf9a-891e68ebbbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:14.754949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6bc54-d2f0-4646-bf9a-891e68ebbbb9 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:14.756504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 450/903] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:14.761772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:14.762155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:14.762335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:14.781897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:14.783085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:14.866999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 454/904] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:14.891329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6bc54-d2f0-4646-bf9a-891e68ebbbb9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:14.977139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:15.001665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6bc54-d2f0-4646-bf9a-891e68ebbbb9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:15.038722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:15.039561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.039841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.040114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.040803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:15.042225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:15.056061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:15.057080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:15.057903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 451/905] 10.222.0.31 () {56 vars in 1132 bytes} [Wed May 25 16:56:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:15.065073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:15.155778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:15.178735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4589e1-be72-49c6-bd97-26a720dd804d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:15.217690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:15.218375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.218658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.218934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.219647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:15.219953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:15.221356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:15.227983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 455/906] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:15.234745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:15.347581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67f0c-572e-4a55-a599-9bd713df6ae7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:15.382840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:15.383509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.383790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.384061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.384783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:15.385092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:15.386462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a36eab-36eb-4b4f-bca9-629e606d3e1a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:15.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 452/907] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:15.397973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:15.451498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2eb9-c1ba-412d-b913-d83b6bbb382c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.451848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2eb9-c1ba-412d-b913-d83b6bbb382c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.452067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2eb9-c1ba-412d-b913-d83b6bbb382c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.454008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 453/908] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:15.459704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.459996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.460281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.468891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:15.483916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:15.485828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:15.520519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b45dd-9b2f-4639-8da3-358734f9051d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:15.558139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:15.559383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.560579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.561123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.562371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] RBAC: Adding query filter params (interface=public, service_id=474246be5a7f44e4958c83f658a4a0ce, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:15.562984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:15.564720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:15.578018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 456/910] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:56:15 2022] GET /identity/v3/endpoints?service_id=474246be5a7f44e4958c83f658a4a0ce&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:15.579348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:15.580151 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 454/910] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:15.589316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:15.599302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:15.705120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133e73-4a44-438b-ac80-94a0226733a3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:15.729353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fdc79-b95a-4737-9ebc-cc16e4132a95 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:15.748340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf246b68-a545-4d7c-9bb5-f30fc7f71485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:15.748968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246b68-a545-4d7c-9bb5-f30fc7f71485 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.749270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246b68-a545-4d7c-9bb5-f30fc7f71485 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.749878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf246b68-a545-4d7c-9bb5-f30fc7f71485 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.750300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf246b68-a545-4d7c-9bb5-f30fc7f71485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:15.751672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf246b68-a545-4d7c-9bb5-f30fc7f71485 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:15.765042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 457/911] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:15 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:56:15.772888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7eda3-a86b-460c-b575-1a25603cfd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:15.774301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7eda3-a86b-460c-b575-1a25603cfd19 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:15.774815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7eda3-a86b-460c-b575-1a25603cfd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:15.775291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7eda3-a86b-460c-b575-1a25603cfd19 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:15.776268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7eda3-a86b-460c-b575-1a25603cfd19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:15.777968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7eda3-a86b-460c-b575-1a25603cfd19 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:15.780980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:15.799730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 455/912] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:15 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:56:16.195720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb5ef9-10f6-4999-8305-3ee1a5a67b33 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.196073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb5ef9-10f6-4999-8305-3ee1a5a67b33 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.196283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb5ef9-10f6-4999-8305-3ee1a5a67b33 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.197911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 458/913] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:16.204047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab666-d8e4-4ca8-8cd5-661cd8b719e0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.204594 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab666-d8e4-4ca8-8cd5-661cd8b719e0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.205099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab666-d8e4-4ca8-8cd5-661cd8b719e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.223199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fe8ab666-d8e4-4ca8-8cd5-661cd8b719e0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:16.224914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fe8ab666-d8e4-4ca8-8cd5-661cd8b719e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:16.304224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 456/914] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:16.331189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb5ef9-10f6-4999-8305-3ee1a5a67b33 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:16.341456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283ca1-ac19-4736-97e5-3836d378bf63 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.342303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283ca1-ac19-4736-97e5-3836d378bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.342303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283ca1-ac19-4736-97e5-3836d378bf63 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.344106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 457/915] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:56:16.350689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.351251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.351754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.374034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:16.375304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:16.418603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:16.448788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 458/916] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:16.463964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb5ef9-10f6-4999-8305-3ee1a5a67b33 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:16.474475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:16.504214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:16.505533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.505823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.506101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.521829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:16.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:16.531102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:16.531944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 459/917] 10.222.0.31 () {56 vars in 1120 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:16.537114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:16.549021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:16.616806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab3cb-5eaf-4fd4-b0ae-6848c6ef8599 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:16.655810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7449d-4fd6-46ef-8dbe-1467c697f5b2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:16.657784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:16.658600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.658885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.659162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.659822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:16.661257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:16.674973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:16.676000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:56:16.676845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:16.680792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 459/918] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:16.682480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:16.703056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:16.712985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:16.714297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.714982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.715401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.716615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:16.717600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:16.719631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:16.733161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 460/919] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:16.738950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:16.798486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9d3e0-5d6f-494e-89dc-60bcdca30322 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:16.817283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:16.843330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:16.845155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.845155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.845155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.847376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:16.847376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:16.849706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:16.859207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 460/920] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:16.860516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:16.883514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146077c-d0a6-4c5f-b5dc-cdfbefce5f1b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:16.929879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:16.931215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:16.931666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:16.932104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:16.948727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:16.950731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:16.973491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:16.974630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:16.975830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:16.975830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:16.975830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:16.975830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:16.981967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 461/921] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:16.982125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e2529-b178-4485-9c80-132b74bd01aa None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:16.983636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:17.037694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:17.041820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.043484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.043940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.044626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.045385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:17.045699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.047086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.055242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 461/922] 10.222.0.31 () {56 vars in 1114 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:17.061608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:17.115270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa296e-ce13-4599-8a78-07d7c353d4d1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:17.122949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:17.155672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.156579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.157089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.157545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.158475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:17.159028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.160659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.178669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 462/923] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:17.179757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:17.197621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff740-346d-4103-a613-fbd089f2cad4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:17.244754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.245903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.246311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.246888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.248341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.250525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.276757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 462/924] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:17.304696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6246-3ebc-4e9f-a1e9-89d6754527a5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:17.308950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:17.352645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.353506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.353791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.354066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.364385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.366025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:17.384125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:17.385166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:17.386537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 463/925] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:56:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:17.392015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:17.511259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:17.517039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b73b4a-6cb4-4f93-a711-ab743e7306e7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:17.568027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.569109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.569612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.570147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.571237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:17.571754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.573439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.593456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 463/926] 10.222.0.31 () {56 vars in 1149 bytes} [Wed May 25 16:56:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:17.599361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:17.709949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b12b-c4e4-4012-bfca-957365f1fde3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:17.748581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.749417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.749702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.749981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.765326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.767051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:17.787385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:17.788303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:17.789214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:17.789214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:17.789214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:17.789214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:17.791114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 464/927] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:17.797699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:17.907191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b710-1038-4136-90ce-393bc2901c29 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:17.954022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:17.954768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:17.955055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:17.955331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:17.956081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:17.956389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:17.957900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be087b0f-c6a3-4d9b-a1f1-1d2e3ffdaf56 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:17.976794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 464/928] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:17.978385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.009064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.085113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f73f2e-0f20-49bd-a0be-2247da2eafe2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.120644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80fef5-4b79-4a81-a4b6-bebd6ee90907 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.120993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80fef5-4b79-4a81-a4b6-bebd6ee90907 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.121230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80fef5-4b79-4a81-a4b6-bebd6ee90907 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.122769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 465/929] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:18.125127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.125956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.126237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.126512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.129088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ca5be-d3e9-4dea-957e-37b0a33bf9ab None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.129618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ca5be-d3e9-4dea-957e-37b0a33bf9ab None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.130102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ca5be-d3e9-4dea-957e-37b0a33bf9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.134307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.135937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.148466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fe6ca5be-d3e9-4dea-957e-37b0a33bf9ab None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:18.150009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fe6ca5be-d3e9-4dea-957e-37b0a33bf9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-23462895-7e9b-404a-a081-d57486a64038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:18.151997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:18.152877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:18.154373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.158556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 465/930] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:18.159941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fe22e-983f-4f45-ac4a-9c663a03541a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.160587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fe22e-983f-4f45-ac4a-9c663a03541a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.160587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fe22e-983f-4f45-ac4a-9c663a03541a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.161979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 466/931] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:18.162591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fe22e-983f-4f45-ac4a-9c663a03541a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.163759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.240700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 466/932] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:18.240700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.240700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.240700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.242628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.260747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:18.262287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:18.279775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fe22e-983f-4f45-ac4a-9c663a03541a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.315997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.316659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.316972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.317248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.318037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:18.318355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.319796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.337099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 467/933] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:18.337099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.339092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 467/934] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:18.339765 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.427555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.447542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d87814-d29b-493f-88da-1e322a8dbd19 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.452252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a8eda-31e0-4c0b-a2a9-8e8b61a4bfe6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.481507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.487593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.487926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.488407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.488770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.488870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.489050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.489159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.489387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/5f8e29b225c249fbab929273e2f573d9/roles/82a2c22eda6f461e8c6db80c8c417c94` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.489728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.491398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.491669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=5f8e29b225c249fbab929273e2f573d9, role_id=82a2c22eda6f461e8c6db80c8c417c94)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.493241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:18.504591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:18.505612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.506453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 468/935] 10.222.0.31 () {56 vars in 1132 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:18.507964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.514150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 468/936] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:18 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/5f8e29b225c249fbab929273e2f573d9/roles/82a2c22eda6f461e8c6db80c8c417c94 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:18.514831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.639883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aef41-7ffd-4632-804e-49a4a97e45e8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.672887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7225e6-3599-460f-8e1a-a44a071b65f7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.680561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.681304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.681590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.681869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.682596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:18.682911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.684342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.687468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.692010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 469/937] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:18.697921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.731365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.732377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.732670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.733142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.733703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.735117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:18.749144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:18.750210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:18.751045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 469/938] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:18.756300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.823712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:18.832822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f14e1-e33a-47b4-a3c3-c156faf749cf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.876249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc550-7417-416e-9202-67972399b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.877212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc550-7417-416e-9202-67972399b918 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.877643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc550-7417-416e-9202-67972399b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.878092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc550-7417-416e-9202-67972399b918 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.878588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1e72d-1a2d-48b3-acf0-0fec5dc70f30 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:18.879105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc550-7417-416e-9202-67972399b918 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:18.879561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc550-7417-416e-9202-67972399b918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.881369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc550-7417-416e-9202-67972399b918 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.887049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 470/939] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:18.896850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc550-7417-416e-9202-67972399b918 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.918656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:18.920199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:18.920763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:18.921103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:18.921926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:18.922552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:18.924448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:18.936642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 470/940] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:18.937931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:18.974363 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:19.017219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc550-7417-416e-9202-67972399b918 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:19.049388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beaf6c-1c55-42ff-85a5-311c8b0d9f09 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:19.053747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:19.054295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:19.054573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:19.054845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:19.055638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:19.057118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:19.081619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:19.084707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 471/941] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:19.113739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:19.114737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:19.115198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:19.115669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:19.116651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:19.117223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:19.118855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:19.125803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 471/942] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:19.131337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:19.253686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89276-cdbf-45f4-b273-9f5ebe4e3bd1 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:19.277523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:19.296410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:19.297401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:19.297859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:19.298333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:19.299306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] RBAC: Adding query filter params (interface=public, service_id=2e9fa54f627545d09b0407dd48dd9bb6, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:19.299796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:19.301371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e9254-1d83-4c89-8c9c-440bbecae003 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:19.307800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 472/943] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:56:19 2022] GET /identity/v3/endpoints?service_id=2e9fa54f627545d09b0407dd48dd9bb6&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:19.315406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:19.430805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996be97-700b-4599-b78c-a84b1946c03b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:19.468277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4c47d-6299-463a-b34f-18d3e98fbb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:19.469262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4c47d-6299-463a-b34f-18d3e98fbb6f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:19.469753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4c47d-6299-463a-b34f-18d3e98fbb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:19.470251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4c47d-6299-463a-b34f-18d3e98fbb6f None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:19.471095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4c47d-6299-463a-b34f-18d3e98fbb6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:19.472625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4c47d-6299-463a-b34f-18d3e98fbb6f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:19.479196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 472/944] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:19 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:56:19.739559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a640-c8cb-4b9a-8183-2888733ec30c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:19.739851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a640-c8cb-4b9a-8183-2888733ec30c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:19.740162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a640-c8cb-4b9a-8183-2888733ec30c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:19.741815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 473/945] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:19.747549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:19.747845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:19.748131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:19.765863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:19.767055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:19.815644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:19.848790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 473/946] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:19.866055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a640-c8cb-4b9a-8183-2888733ec30c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:19.975568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a640-c8cb-4b9a-8183-2888733ec30c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:20.011714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:20.012856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:20.013366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:20.013859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:20.014807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:20.016438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:20.018125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING keystone.server.flask.common [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 16:56:20.037316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.sql.core [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 16:56:20.037316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 16:56:20.037316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [parameters: {'id': '0756ab9023d9454e854d27044887db8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 16:56:20.037316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0756ab9023d9454e854d27044887db8c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0756ab9023d9454e854d27044887db8c. May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application conn.query(q) May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:56:20.055132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result.read() May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 16:56:20.055982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application next(self.gen) May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application yield resource May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application next(self.gen) May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.session.rollback() May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.force_reraise() May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise self.value May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application session.commit() May 25 16:56:20.056940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._prepare_impl() May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.session.flush() May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._flush(objects) May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application compat.raise_( May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application flush_context.execute() May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 16:56:20.057808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rec.execute(self) May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 16:56:20.058877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application conn.query(q) May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result.read() May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:56:20.059789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [parameters: {'id': '0756ab9023d9454e854d27044887db8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:20.060670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:20.061560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0756ab9023d9454e854d27044887db8c. May 25 16:56:20.062708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:20.065032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 474/947] 10.222.0.31 () {60 vars in 1140 bytes} [Wed May 25 16:56:19 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:20.072999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:20.179007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c3335-1c78-461f-8ce6-2270756885d1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:20.216343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:20.217436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:20.217868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:20.218288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:20.225565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:20.227308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-55a7e215-37a4-48c0-8aae-7bb1284c4855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:20.241887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:20.242977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:20.244365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:20.251173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 474/948] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:20.252995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:20.299427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:20.365423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1770c-98e3-4e07-ab3b-f88c799b1a92 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:20.406798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:20.407544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:20.407868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:20.408200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:20.409113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:20.409424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:20.411064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6927a8c-fb21-42c2-938e-7c793468250b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:20.433548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 475/949] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:20.831589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec436-35d0-40e9-9787-0e2ece8a2d49 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:20.832046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec436-35d0-40e9-9787-0e2ece8a2d49 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:20.832415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec436-35d0-40e9-9787-0e2ece8a2d49 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:20.834133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 475/950] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:20.839640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:20.840035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:20.840431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:20.860513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:20.862188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:20.934402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 476/951] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:20.958242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec436-35d0-40e9-9787-0e2ece8a2d49 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.002600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:21.069902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec436-35d0-40e9-9787-0e2ece8a2d49 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:21.113467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:21.116698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.116698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.116698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.128216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:21.137280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:21.138865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:21.139894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 476/952] 10.222.0.31 () {56 vars in 1120 bytes} [Wed May 25 16:56:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:21.146002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.181893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:21.262174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a11ab-e95e-4d02-af84-afc09c9f3770 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:21.300523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:21.301224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.301505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.301783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.302527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:21.302832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:21.304215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:21.313893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 477/953] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:56:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:21.319396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.431953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:21.438789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830955-5ef2-4566-9a21-4187ea6689d0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:21.482820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:21.483625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.483902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.484161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.494934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:21.496378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-32fb4723-27a8-43e6-8a59-cc885748c4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:21.516079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:21.518117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:21.520190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:21.520190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:21.520190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:21.520190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:21.520190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 477/954] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:21.523191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.625156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:21.634798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc811b1-37be-4e9b-84f5-db526e7ff440 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:21.653648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fdbe1-d538-46fc-8fba-de9c7258d736 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.654584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fdbe1-d538-46fc-8fba-de9c7258d736 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.654883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fdbe1-d538-46fc-8fba-de9c7258d736 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.656624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 478/955] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:21.662656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.662941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.663205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.690925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:21.692517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:21.701707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:21.703457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.703912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.704351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.706709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:21.707033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:21.710453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:21.726648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 478/956] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:21.732561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.774419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 479/957] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:21.797245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.858258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63802-d772-49fb-ac42-9e8a1323d42a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:21.885410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:21.895009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:21.895830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.896115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.896395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.904751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:21.906370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:21.908422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8801f0e-fbf3-49c8-b337-7a1e00fcb21d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fcbbab7b-31ff-4740-ad3d-da9d8b373ed5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:21.921519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:21.922470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:21.923424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 479/958] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:56:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:21.924698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b55c1-cf8a-4ea4-9980-2278b556a416 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.924698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b55c1-cf8a-4ea4-9980-2278b556a416 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.924698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b55c1-cf8a-4ea4-9980-2278b556a416 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.925980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 480/959] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:21.928811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b55c1-cf8a-4ea4-9980-2278b556a416 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:21.947822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:21.950419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:21.951520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.951991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.952256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.953233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:21.954603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-78e88add-aa6b-43cc-b48c-0ff7073888f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:21.967289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:21.968525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:21.969574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 480/960] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:21.974541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:21.974838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:21.975119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:21.995351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:21.996555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:22.049690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b55c1-cf8a-4ea4-9980-2278b556a416 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.076698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 481/961] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:22.076698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.103545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.104965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.105263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.105544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.106392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:22.106955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.109349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.132412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 481/962] 10.222.0.31 () {56 vars in 1149 bytes} [Wed May 25 16:56:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:22.133092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.155539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.185936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587852ce-e466-4ac8-b181-a915be681a5f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.206985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.222981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.223646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.223925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.224194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.224944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:22.225250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.226612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.236252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 482/963] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:22.236252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.246150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439128d9-3477-40d6-98a3-e60817e62ed0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.286454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.287267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.287546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.287817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.288471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.290180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:22.306183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:22.307184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:22.308090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:22.308876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 482/964] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:22.310761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.348021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17c3b-b153-4ede-bf92-c95c4a3a8ca2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.385901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.386556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.386841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.387119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.396582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.419358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214114-766d-41bd-986a-d743a7afb1ce None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.458447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.459452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.459924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.460396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.461326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:22.461852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.463236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.464158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.464617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.467264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.473049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 483/965] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:22.473841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.592347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc02bb-5621-49a5-9a36-f5894ded6592 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.606844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 483/966] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:22.615864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.633275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.633979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.634271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.634552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.635298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:22.635615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.637150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.650009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 484/967] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:22.652820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.677501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.746002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.771440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b49d-8aeb-4289-a6de-46b1560a9242 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.798497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d88e-34bc-4b56-9713-cc68eb821655 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.820612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.821717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.822163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.822657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.834313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.835846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.843102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:22.844354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.844823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.845696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.846845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:22.847336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:22.848873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e7928564-c647-4612-b101-74f9da6885c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:22.854510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:22.855391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:22.856299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:22.856299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:22.856299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:22.856299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:22.856299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 484/969] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:22.856626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 485/969] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:22.857557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e2c5-ca1a-4854-a4d7-695e2176b6f7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:22.857845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e2c5-ca1a-4854-a4d7-695e2176b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:22.858126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e2c5-ca1a-4854-a4d7-695e2176b6f7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:22.859736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 485/970] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:22.860840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.861328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e2c5-ca1a-4854-a4d7-695e2176b6f7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:22.966778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:22.967956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c2161-19fd-4607-9a0d-985081a6a15b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.979206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e2c5-ca1a-4854-a4d7-695e2176b6f7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:22.994070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:23.011056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f42762-b698-42a1-b666-ebb7fab47d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.011056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f42762-b698-42a1-b666-ebb7fab47d7b None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.011324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f42762-b698-42a1-b666-ebb7fab47d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.011552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f42762-b698-42a1-b666-ebb7fab47d7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.012202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f42762-b698-42a1-b666-ebb7fab47d7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.014240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f42762-b698-42a1-b666-ebb7fab47d7b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.021984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.022612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.022897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.023173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.023897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:23.024223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.026346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.036931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 486/971] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:23.038664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.039039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.039213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.052029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 486/972] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:23.057783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:23.067064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:23.068299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:23.154119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 487/973] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:23.178338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:23.215080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80b2a-018c-44e3-8d28-b061b0878f74 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:23.267652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.268454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.268771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.269052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.277487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.279434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:23.294948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:23.295900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:23.296917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 487/974] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:23.302637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:23.304718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e525b-92d1-4ea5-ba0b-aa34c4ec3ca4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:23.317513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:23.319825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:23.349773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.350566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.350853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.351129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.352022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.354369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.372644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.sql.core [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 16:56:23.372644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 16:56:23.372644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [parameters: {'user_id': '221f1c4f48c6409db0d6798ca20f5c58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 16:56:23.372644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application conn.query(q) May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result.read() May 25 16:56:23.382959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:56:23.383962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application next(self.gen) May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application yield resource May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application next(self.gen) May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.session.rollback() May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.force_reraise() May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise self.value May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application session.commit() May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 16:56:23.384965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._prepare_impl() May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.session.flush() May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._flush(objects) May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application compat.raise_( May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application flush_context.execute() May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rec.execute(self) May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 16:56:23.385840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:56:23.386713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application conn.query(q) May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application result.read() May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:56:23.388170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [parameters: {'user_id': '221f1c4f48c6409db0d6798ca20f5c58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:23.393808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 16:56:23.394632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 488/975] 10.222.0.31 () {60 vars in 1131 bytes} [Wed May 25 16:56:23 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:23.395529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:23.437954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eff1f-19ca-46e7-9d85-262670c86472 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:23.476671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.477609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.478040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.478511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.479463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:23.479917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.482938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.496156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 488/976] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:23.504759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:23.504953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1024-e94e-4b03-948e-ba9c64c79105 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:23.555864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.557209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.557637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.558362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.570785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.573637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.585467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:23.596787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:23.597970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:56:23.599028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:23.606954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 489/977] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:23.607423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:23.630094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395b6a6-4fd1-4ff1-a355-cd75cfbef982 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:23.655777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:23.671393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.672052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.672331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.672604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.673678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] RBAC: Adding query filter params (role.id=82a2c22eda6f461e8c6db80c8c417c94, scope.project.id=081f5d965327435dba6971aab789335e, user.id=5f8e29b225c249fbab929273e2f573d9) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:23.673879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.675465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5e48-5133-418b-a3d7-3a494225d04f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.691750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 489/978] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:23 2022] GET /identity/v3/role_assignments?user.id=5f8e29b225c249fbab929273e2f573d9&scope.project.id=081f5d965327435dba6971aab789335e&role.id=82a2c22eda6f461e8c6db80c8c417c94 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:23.750211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05705-7605-4a5f-9b62-1b516d8a8ffb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:23.791297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:23.791988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:23.792271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:23.792547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:23.793453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:23.794530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:23.796274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ebd57-b140-4d58-9d3c-37eedbbb0e12 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:23.842185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 490/979] 10.222.0.31 () {56 vars in 1101 bytes} [Wed May 25 16:56:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:24.771086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa01a7-1250-4744-9ceb-e9a8036ab7a2 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:24.771596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa01a7-1250-4744-9ceb-e9a8036ab7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:24.771673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa01a7-1250-4744-9ceb-e9a8036ab7a2 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:24.773173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 490/980] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:24.778822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3db3-79cc-444c-9da1-bdcbb8e5f2f9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:24.779347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3db3-79cc-444c-9da1-bdcbb8e5f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:24.779522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3db3-79cc-444c-9da1-bdcbb8e5f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:24.797364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d80b3db3-79cc-444c-9da1-bdcbb8e5f2f9 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:24.798883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d80b3db3-79cc-444c-9da1-bdcbb8e5f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:24.869888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 491/981] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:24.896899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa01a7-1250-4744-9ceb-e9a8036ab7a2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:25.006473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa01a7-1250-4744-9ceb-e9a8036ab7a2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:25.041526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efce90-bfa2-4f04-8168-89b945251107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:25.042198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efce90-bfa2-4f04-8168-89b945251107 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.042482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efce90-bfa2-4f04-8168-89b945251107 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.042759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efce90-bfa2-4f04-8168-89b945251107 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.043491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efce90-bfa2-4f04-8168-89b945251107 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:25.045144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efce90-bfa2-4f04-8168-89b945251107 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:25.047358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:25.062545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 491/982] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:24 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:25.404941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40a343-6270-4362-9bd1-99a974b7936c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.405345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40a343-6270-4362-9bd1-99a974b7936c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.405541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40a343-6270-4362-9bd1-99a974b7936c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.406873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 492/983] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:25.412416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.412734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.413016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.431640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:25.432842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:25.506767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 492/984] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:25.529964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40a343-6270-4362-9bd1-99a974b7936c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:25.549762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:25.635573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40a343-6270-4362-9bd1-99a974b7936c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:25.670232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:25.671018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.674567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.674567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.674567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:25.674567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:25.693046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:25.694058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:25.694889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:25.697013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 493/985] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:25.701043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:25.805127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c8e45-92e6-4543-9807-ccb143081d4c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:25.828125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:25.844168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:25.844869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.845157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.845433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.846147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:25.846455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:25.847819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e64a2-9267-4664-91a2-a0fbc00b0a2c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:25.852897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 493/986] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:25.858395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:25.945789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:25.965167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613de0b-f7d7-4199-a47f-fdeac7a5b8bc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:25.989433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288fad-9f75-4e02-ac5f-8bb67ea198f5 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.989722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288fad-9f75-4e02-ac5f-8bb67ea198f5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.990000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288fad-9f75-4e02-ac5f-8bb67ea198f5 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.991342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 494/987] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:25.997578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:25.997828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:25.999054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:25.999539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:26.000203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:26.000485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:26.000789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:26.001540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:26.001802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:26.003168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:26.014036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 494/988] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:26.015060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:26.020520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:26.021822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:26.091592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 495/989] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:26.113837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:26.114945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73d4b-d395-4a35-8793-61c7de0c7c9e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:26.150086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:26.150744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:26.151025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:26.151297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:26.152144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] RBAC: Adding query filter params (interface=admin, service_id=2e9fa54f627545d09b0407dd48dd9bb6, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:26.152472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:26.154454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:26.159926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 495/990] 10.222.0.31 () {56 vars in 1249 bytes} [Wed May 25 16:56:26 2022] GET /identity/v3/endpoints?service_id=2e9fa54f627545d09b0407dd48dd9bb6&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:26.165242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:26.177876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:26.232998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab08bad-5e46-4a62-a31a-7f808aef7676 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:26.249003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:26.271713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:26.272509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:26.272741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff903e37-ab5f-409f-a8cf-c3039b1a45b7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:26.272849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:26.273094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] PATH_INFO: `/v3/services/image` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:26.273747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:26.275124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:26.286961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:26.287957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:26.288830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 496/991] 10.222.0.31 () {56 vars in 1105 bytes} [Wed May 25 16:56:26 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:26.295060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:26.310807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:26.311484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:26.312028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:26.312297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:26.313007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:26.314409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:26.328712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 496/992] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:26 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:56:26.416150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f887d-29ba-4028-8829-e8b1b432bf99 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:26.454053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:26.454736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:26.455024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:26.455301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:26.456020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] RBAC: Adding query filter params (name=image) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:26.456329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:26.457748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a618f-438f-4f3a-923e-c315b11a8cba None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:26.463247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 497/993] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:26.469293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:26.553529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:26.579985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f580-11d4-48ee-a01d-9fd72a854e9a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:26.613895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:26.614560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:26.614839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:26.615108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:26.615808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:26.616112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:26.617524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09fd57-24e5-4be6-b2cf-59e9b8197ff1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:26.628772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 497/994] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:27.307813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038925-820a-4b7e-bcd7-02f9731a8f9a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:27.308349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038925-820a-4b7e-bcd7-02f9731a8f9a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:27.308349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038925-820a-4b7e-bcd7-02f9731a8f9a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:27.310162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 498/995] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:27.315665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:27.316079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:27.316234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:27.333371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:27.334577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:27.404453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 498/996] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:27.426600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038925-820a-4b7e-bcd7-02f9731a8f9a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:27.476915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:27.535584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038925-820a-4b7e-bcd7-02f9731a8f9a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:27.569168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:27.569882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:27.570160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:27.570428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:27.571062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:27.572422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:27.584489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:27.585655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:27.586494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:27.588761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 499/997] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:27.591684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:27.659032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:27.703680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff8fb0-b2ef-41d2-83cc-92719666d9cf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:27.737490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:27.738413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:27.738843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:27.739291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:27.740164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:27.740622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:27.742236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:27.748859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 499/998] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:27.754414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:27.856463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f121fb-bc7e-4ca4-b896-05896e564fb8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:27.863571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:27.892339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:27.893031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:27.893311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:27.893580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:27.894275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:27.894581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:27.895932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:27.900893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 500/999] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:27.906777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:28.013756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdebf-8497-44bd-92fd-7fbdda9180b2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:28.042451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:28.049078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:28.049734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.050015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.050287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.051065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] RBAC: Adding query filter params (interface=public, service_id=9f648f571cea457baf6998b0154c8450, region_id=RegionOne) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:28.051372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:28.052754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842aed-a37d-4b80-832a-f474a75a1b30 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:28.063623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 500/1000] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:56:27 2022] GET /identity/v3/endpoints?service_id=9f648f571cea457baf6998b0154c8450&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:28.065101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:28.166527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf4e97-4c1b-4ca5-920f-abf73b93ad2d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:28.200661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594da34-d45f-44d0-8d30-276e8d6600d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:28.201424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594da34-d45f-44d0-8d30-276e8d6600d5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.201707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594da34-d45f-44d0-8d30-276e8d6600d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.201982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594da34-d45f-44d0-8d30-276e8d6600d5 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.202711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594da34-d45f-44d0-8d30-276e8d6600d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:28.204089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594da34-d45f-44d0-8d30-276e8d6600d5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:28.216706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 501/1001] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:28 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:56:28.560498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b767238-120b-4a08-bcef-51babe062017 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.561022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b767238-120b-4a08-bcef-51babe062017 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.561098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b767238-120b-4a08-bcef-51babe062017 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.562848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 501/1002] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:28.567950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.568351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.568543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.586009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:28.587184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:28.614676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:28.657291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 502/1003] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:28.680702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b767238-120b-4a08-bcef-51babe062017 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:28.787816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b767238-120b-4a08-bcef-51babe062017 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:28.821710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:28.822436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.822714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.822982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.823623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:28.825638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3b148020-b9c0-4850-a371-40bda5aadcd2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:28.837476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:28.838480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:56:28.839322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:28.844756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 502/1004] 10.222.0.31 () {56 vars in 1126 bytes} [Wed May 25 16:56:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:28.845575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:28.877996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b880e-3e0e-474d-8ec9-f45685494461 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.878282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b880e-3e0e-474d-8ec9-f45685494461 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.878553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b880e-3e0e-474d-8ec9-f45685494461 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.879909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 503/1005] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:56:28.885053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:28.885347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:28.885624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:28.905269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:28.906457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:28.954285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca387-132e-4d67-9ab8-f47d17df37c1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:28.983111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:28.998362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 504/1006] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:29.000816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:29.001652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:29.002110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:29.002552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:29.003418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:29.003870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:29.005434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:29.010813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 503/1007] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:29.016531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:29.023066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:29.054532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:29.132634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d2c64-ed09-4e25-8a62-870dc8452055 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:29.141093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c47ac3-773b-4b76-8f57-dab43a6d4a59 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:29.167759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:29.169569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:29.170047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:29.170343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:29.171078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:29.171397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:29.172822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:29.177803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 505/1008] 10.222.0.31 () {56 vars in 1122 bytes} [Wed May 25 16:56:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:29.183349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:29.185339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e0e1-1cbc-4b88-a634-62166f402c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:29.186017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e0e1-1cbc-4b88-a634-62166f402c50 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:29.186297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e0e1-1cbc-4b88-a634-62166f402c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:29.186569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e0e1-1cbc-4b88-a634-62166f402c50 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:29.187765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0e0e1-1cbc-4b88-a634-62166f402c50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:29.188924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0e0e1-1cbc-4b88-a634-62166f402c50 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:29.205869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 504/1009] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:29 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:56:29.254554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:29.305076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21735a-f634-4f3c-9456-037a26e02956 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:29.351459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614f71-a565-4328-9b97-9bbf2e333e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:29.352131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614f71-a565-4328-9b97-9bbf2e333e4e None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:29.352414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614f71-a565-4328-9b97-9bbf2e333e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:29.352714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614f71-a565-4328-9b97-9bbf2e333e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:29.353492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614f71-a565-4328-9b97-9bbf2e333e4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:29.354929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614f71-a565-4328-9b97-9bbf2e333e4e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:29.380707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 506/1010] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:56:30.492414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d73a88-7018-401b-bfef-0c90a132d2ee None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:30.493133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d73a88-7018-401b-bfef-0c90a132d2ee None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:30.493133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d73a88-7018-401b-bfef-0c90a132d2ee None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:30.494532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 505/1011] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:30.499629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:30.500063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:30.500168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:30.518697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:30.519943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:30.600767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 507/1012] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:30.623402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d73a88-7018-401b-bfef-0c90a132d2ee None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:30.717489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:30.732150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d73a88-7018-401b-bfef-0c90a132d2ee None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:30.767216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:30.767946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:30.768233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:30.768507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:30.769183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:30.770545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:30.782979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:30.783939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:30.784831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 506/1013] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:30.791913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:30.828524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:30.896005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583abc1-834f-456d-bcbd-d3b993fa3665 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:30.930674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:30.931336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:30.931618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:30.931886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:30.932580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:30.932932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:30.934427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:30.944109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 508/1014] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:30.945424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:31.057497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2c2ac-74a3-48e4-b4d0-a1b93154bcd7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:31.093182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:31.093852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.094138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.094418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.095121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:31.095437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:31.096833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c5c0-cf9f-4a95-9a55-403b758ef6ee None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:31.106709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 507/1015] 10.222.0.31 () {56 vars in 1112 bytes} [Wed May 25 16:56:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:31.107886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:31.212601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:31.218206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b9342-6859-4eed-9cd2-bd075b776bb0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:31.254495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943c07b-affe-441c-b095-094786184d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:31.255160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943c07b-affe-441c-b095-094786184d2c None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.255445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943c07b-affe-441c-b095-094786184d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.255721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943c07b-affe-441c-b095-094786184d2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.256463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943c07b-affe-441c-b095-094786184d2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:31.257872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943c07b-affe-441c-b095-094786184d2c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:31.284793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 509/1016] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:31.514152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677365ed-545d-4ebb-afe2-325c255bccd9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.514641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677365ed-545d-4ebb-afe2-325c255bccd9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.514641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677365ed-545d-4ebb-afe2-325c255bccd9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.515986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 508/1017] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:31.521422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.521848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.522022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.539499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:31.540743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:31.618675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 510/1018] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:31.639480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b28da4-9f35-46a1-9efd-a41e75b232d0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.639769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b28da4-9f35-46a1-9efd-a41e75b232d0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.640044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b28da4-9f35-46a1-9efd-a41e75b232d0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.641561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 509/1019] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:31.643245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:31.646453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.646744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.647027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.663485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:31.664666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:31.682826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:31.738954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:31.743814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 510/1020] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:31.764855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba4f7f-2a16-4b18-8291-4ac4617f075a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:31.769136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:31.802159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:31.802952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.803234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.803508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] PATH_INFO: `/v3/services/image` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.804183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:31.805595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:31.817354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:31.818350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:31.820514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 511/1021] 10.222.0.31 () {56 vars in 1105 bytes} [Wed May 25 16:56:31 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:31.824333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:31.882528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ace80-82ee-4654-9efc-5afb99e43570 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:31.920400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:31.921553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.922028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.922488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.923905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:31.925586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:31.927301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 511/1022] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:31.932941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:31.939324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31f06b-0922-439b-b183-8177ac603e7c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:31.950958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:31.975183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:31.975874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:31.976136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:31.976412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:31.977143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:31.977453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:31.978832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:31.984996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 512/1023] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:31.990521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:32.003858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:32.055567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6d04a-d170-4d5b-a4c7-8f4b1ed311bc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:32.095228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:32.095998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:32.096284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:32.096556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:32.097291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:32.097587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766534c-15ff-41f8-982f-0d393aed00d2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:32.098720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:32.127053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 512/1024] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:31 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:56:32.135222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:32.135917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:32.136213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:32.136469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:32.138459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] RBAC: Adding query filter params (type=image) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:32.138797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:32.140257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:32.146300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 513/1025] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:32.152071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:32.234146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:32.273650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0e31-3f61-47a8-9c97-8c0bc0199f01 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:32.310293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:32.310965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:32.311249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:32.311525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:32.312579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] RBAC: Adding query filter params (interface=public, service_id=6660d5d6497b47b9a76b95df80d98066, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:32.312925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:32.314315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb9044-17d0-4edd-8d83-2106d826d69b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:32.320435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 513/1026] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:56:32 2022] GET /identity/v3/endpoints?service_id=6660d5d6497b47b9a76b95df80d98066&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:32.327403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:32.412321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:32.439703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416218f-03f3-47af-8394-3b19c34fa82e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:32.477068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f413f2-e83e-433b-bfc9-09c9e156a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:32.477731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f413f2-e83e-433b-bfc9-09c9e156a935 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:32.478009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f413f2-e83e-433b-bfc9-09c9e156a935 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:32.478277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f413f2-e83e-433b-bfc9-09c9e156a935 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:32.478945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f413f2-e83e-433b-bfc9-09c9e156a935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:32.480306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f413f2-e83e-433b-bfc9-09c9e156a935 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:32.492767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 514/1027] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:56:32 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:56:33.637766 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e6c0-d458-4806-860e-0307f116bbd3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:33.638698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e6c0-d458-4806-860e-0307f116bbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:33.638698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e6c0-d458-4806-860e-0307f116bbd3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:33.639824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 514/1028] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:33.644850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:33.645228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:33.645419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:33.662965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:33.664147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:33.743833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 515/1029] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:33.767760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3e6c0-d458-4806-860e-0307f116bbd3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:33.877476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3e6c0-d458-4806-860e-0307f116bbd3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:33.906192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:33.912886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:33.913694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:33.913975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:33.914254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:33.926510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:33.935873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:33.937294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:33.938142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:33.939370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 515/1030] 10.222.0.31 () {56 vars in 1120 bytes} [Wed May 25 16:56:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:33.943293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.011659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:34.047913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9fa4f-1a24-4807-a12c-fa43e95eceac None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.082159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.082828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.083108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.083381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.084119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:34.084423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.085837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.099074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 516/1031] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:56:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:34.100319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.208761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277f175-c28e-434b-8d5b-7a34255f6fcc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.246810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.247629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.247914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.248188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.259588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.261082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-75d7b69d-3187-4c54-b382-881df910f2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:34.279717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:34.280651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:34.282160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:34.282160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:34.282160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:34.282160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:34.282654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 516/1032] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:34.286722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.390171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09050e2f-633f-4843-b6ca-3850215a7f24 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.419414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:34.423874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d00481-f9ce-44e1-b07a-7dff8ee3c31e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.424279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d00481-f9ce-44e1-b07a-7dff8ee3c31e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.424556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d00481-f9ce-44e1-b07a-7dff8ee3c31e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.426122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 517/1033] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:56:34.427304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.427975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.428259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.428536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.429296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:34.429608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.430974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.431144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.431405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.431699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.448228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 517/1034] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:34.448934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:34.450085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.450886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:34.487953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:34.521274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 518/1035] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:34.547663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.566130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8186f3-8752-40f3-ac19-eacc0247db5b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.604302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.605566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.606645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.607108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.615462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.617143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:34.632942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:34.633890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:34.634898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:34.637256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 518/1036] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:56:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:34.642612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.658033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7add9-f2ba-4c6a-81e9-535d8c6a3376 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.703989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.705104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.705597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.705736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:34.706171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.707247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.708658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.710640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 519/1037] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:34.716056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.771367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:34.777114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64665f3-fd14-4cb5-961c-1c89e44aab43 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.817197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.818230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.818577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.818923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.819830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:34.820210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.821766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61820a-d520-4493-bc2b-71910f27cc12 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.839694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 519/1038] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:56:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:34.842123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5c2b-5ff3-4997-9595-a11a5f1abd71 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.842631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5c2b-5ff3-4997-9595-a11a5f1abd71 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.842904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5c2b-5ff3-4997-9595-a11a5f1abd71 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.844323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 520/1039] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:34.845637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb5c2b-5ff3-4997-9595-a11a5f1abd71 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:34.848150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a10bb-a757-4f22-86aa-4a9c3fa319ce None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.887128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6bbc-55e2-4370-a930-71c553a647bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:34.888124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6bbc-55e2-4370-a930-71c553a647bb None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.888414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6bbc-55e2-4370-a930-71c553a647bb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.888714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6bbc-55e2-4370-a930-71c553a647bb None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.889420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d6bbc-55e2-4370-a930-71c553a647bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:34.890852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d6bbc-55e2-4370-a930-71c553a647bb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:34.911463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 520/1040] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:56:34 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:34.912649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:34.912970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:34.913234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:34.938524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:34.940641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:34.961914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb5c2b-5ff3-4997-9595-a11a5f1abd71 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:34.974584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.015871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.016601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.016963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.017213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.033067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 521/1041] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:35.047038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.086174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.110339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.111792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.180832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afa57c-5f54-49cf-b720-d512df454115 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.220028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.220868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.221147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.221426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] PATH_INFO: `/v3/services/image` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.222081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.223445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.227498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 521/1042] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:56:35.233794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:35.235794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:35.236832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:35.237657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 522/1043] 10.222.0.31 () {56 vars in 1105 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:35.242950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.247534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.343940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.345242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e8cde-9560-4f4d-9389-cadf771b955c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.355530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8b9d-b5b3-4e4a-b5f9-f670b658bd10 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.384227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.385301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.385732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.386258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.391452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.392111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.392396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.392695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.393397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:35.393706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.395069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.398939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.399937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 523/1044] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:35.401472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.405761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:35.421671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:35.422844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:35.423776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:35.423776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:35.423776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:35.423776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:35.423776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 522/1045] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:35.429165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.493544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.518233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451144-f43e-4e90-b474-711a599f9ad0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.540545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc40c8-417c-4197-8c76-040339e7d921 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.555345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.556021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.556308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.556588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.557327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] RBAC: Adding query filter params (type=image) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:35.557640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.559711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.565610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 524/1046] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:35.570937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.578525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.579194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.579479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.579754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.580481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:35.580823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.582343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.591874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.599739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 523/1047] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:35.600647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.695073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627e737-3eb3-47cc-b16e-dcdbdbcf4104 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.710787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639084a-dace-4f09-8e45-1f477ee78605 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.732669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.734101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.734764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.735061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.735388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.736048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.737492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.749242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.750171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.750381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.750675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.757497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 525/1048] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:56:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:56:35.763309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.764865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:35.781337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:35.782374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:35.788658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 524/1049] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:35.789413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:35.877186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:35.914229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ac24-b73d-444f-a82e-ebada0508a79 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:35.953303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:35.953969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:35.954253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:35.954528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:35.955308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:35.955613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:35.957091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405000-e093-428a-a6d1-7994cc789390 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:35.970748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 526/1050] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:35.976744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:36.080779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cabc-c015-4b2f-8e54-bffb7af81f54 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:36.118119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:36.118779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:36.119062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:36.119427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:36.120172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] RBAC: Adding query filter params (role.id=82a2c22eda6f461e8c6db80c8c417c94, scope.project.id=081f5d965327435dba6971aab789335e, user.id=600d472e73da4c96af486c16a3f7df81) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:36.120485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:36.122307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aecc9b-16e0-4ffa-a17f-e97f23ebed2a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:36.128188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 525/1051] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:35 2022] GET /identity/v3/role_assignments?user.id=600d472e73da4c96af486c16a3f7df81&scope.project.id=081f5d965327435dba6971aab789335e&role.id=82a2c22eda6f461e8c6db80c8c417c94 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:37.194622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f1c1-cade-4110-b223-fa07ac659eba None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:37.195160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f1c1-cade-4110-b223-fa07ac659eba None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:37.195160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f1c1-cade-4110-b223-fa07ac659eba None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:37.196642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 527/1052] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:37.202362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:37.202756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:37.202917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:37.219446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:37.220624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:37.263597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:37.291984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 526/1053] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:37.316815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f1c1-cade-4110-b223-fa07ac659eba None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:37.418722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f1c1-cade-4110-b223-fa07ac659eba None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:37.448300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:37.455630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:37.456419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:37.456791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:37.456988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:37.467209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:37.474894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:37.475822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:37.476649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:37.481359 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 528/1054] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:37.482910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:37.581340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881655eb-eaf8-408c-86cc-87ddd410e4a4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:37.615133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:37.615802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:37.616081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:37.616354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:37.617117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:37.617422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:37.618783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:37.634220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 527/1055] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:37.635959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:37.744902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e43c-42f6-4d2a-b3a0-87a2b2f7c3c8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:37.779787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230657-e5cc-416a-b9b1-779c14764d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:37.781001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230657-e5cc-416a-b9b1-779c14764d1b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:37.781460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230657-e5cc-416a-b9b1-779c14764d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:37.781924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230657-e5cc-416a-b9b1-779c14764d1b None admin] PATH_INFO: `/v3/users/ee5c270180bd4b4e883a8a302618e15b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:37.795613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05230657-e5cc-416a-b9b1-779c14764d1b None admin] RBAC: Authorizing `identity:get_user(user_id=ee5c270180bd4b4e883a8a302618e15b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:37.797320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05230657-e5cc-416a-b9b1-779c14764d1b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:37.799177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 529/1056] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:37 2022] GET /identity/v3/users/ee5c270180bd4b4e883a8a302618e15b => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:37.804938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:37.845369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:37.914446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2536c-e5e5-4393-8512-6d8492634e57 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:37.954810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:37.955792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:37.956249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:37.956731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.025818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.027618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.031315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff36f4-eccd-4d14-a0ef-70f106e444a7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.031615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff36f4-eccd-4d14-a0ef-70f106e444a7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.031900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff36f4-eccd-4d14-a0ef-70f106e444a7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.033298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 530/1057] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:38.039052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.039393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.039670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.056629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:38.057855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:38.071353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.106131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.133962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 531/1058] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:38.144725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 528/1059] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:38.149250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.157757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.255289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7040-0ae8-48d9-92f3-b038d25ce9fe None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.270020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5aad9-fe80-4724-ac47-c05a9c5681ab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.294822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.294822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.294822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.294822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.296090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] RBAC: Authorizing `identity:get_project(project_id=51ba1212b56943efb78e8e5b41bc87fd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.297573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.299451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 532/1060] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:38.305249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.312926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.313582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.313860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.314133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.318176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.355337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.390597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.392058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.412149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe22a27-c7d8-4419-9d4f-bcbfdf4a4b4f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.446820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.447463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.447740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.448010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.448860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=51ba1212b56943efb78e8e5b41bc87fd, user.id=ee5c270180bd4b4e883a8a302618e15b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:38.449169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.450703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ab4b-cb44-4322-b111-b0f3a9ce9f92 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.456137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 533/1061] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/role_assignments?user.id=ee5c270180bd4b4e883a8a302618e15b&scope.project.id=51ba1212b56943efb78e8e5b41bc87fd&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:38.457332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a094-5c9a-4a48-9d9a-147028ff3d05 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.457617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a094-5c9a-4a48-9d9a-147028ff3d05 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.457890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a094-5c9a-4a48-9d9a-147028ff3d05 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.459104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 534/1062] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:38.465034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.465318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.465595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.485206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:38.486443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:38.511480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 529/1063] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:56:38.517880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.559900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.567556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 535/1064] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:38.590981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.632360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f93a5-b0db-4a45-93e6-3bb58cb46367 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.635912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.678966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.679846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.680202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.680571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.693330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.694983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:38.715598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:38.716532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:38.717550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:38.717550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:38.717550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:38.717550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:38.717550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 530/1065] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:38.720733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477dc4a-d949-4755-b079-fd300ab99553 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.722789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.758182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.758999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.759281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.759561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.770833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:38.779757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:38.780733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:38.782167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 536/1066] 10.222.0.31 () {56 vars in 1120 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:38.787024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:38.828450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.844459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b0b3-9ad8-4c0b-ac55-808b15ee0d81 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.881179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.882126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.882618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.883086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.883961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:38.884417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.885960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.894161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:38.897711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e5b4-bdef-46b7-9bb2-aee05b3f130b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:38.898293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 531/1067] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:38.942208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:38.942902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:38.943247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:38.943526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:38.944288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:38.944598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:38.946029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:38.957866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 537/1068] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:38.963987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:39.087070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada7b6-7c0e-4f89-af76-aef1e83ff844 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:39.124644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:39.125720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:39.126006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:39.126282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:39.137833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:39.139296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:39.147755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:39.158158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:39.159263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:39.160254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:39.160254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:39.160254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:39.160254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:39.160254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 532/1069] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:39.166765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:39.274589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d551-afca-40a8-aaaa-3c4cb9644ec6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:39.308358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:39.309615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:39.309895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:39.310170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:39.310879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:39.311534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:39.313183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:39.324657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 538/1070] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:39.330322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:39.429254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb85f7-cbfc-4c40-a6aa-b7ad57ca7f6e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:39.461635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:39.462414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:39.462697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:39.462970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:39.470844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:39.472276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:39.486564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:39.487721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:39.488703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 533/1071] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:56:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:39.493479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:39.517746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:39.595810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87db42-837c-40df-8d65-ceb3c704f2ca None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:39.629572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:39.630253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:39.630537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:39.630809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:39.631647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:39.631959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:39.633430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:39.651086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 539/1072] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:56:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:39.656894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:39.716411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:39.758245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419f3a3-0efc-4056-abb1-f672ed68c68a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:39.790886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:39.791675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:39.791956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:39.792233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:39.803593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:39.805120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:39.822950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:39.823924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:39.824986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:39.824986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:39.824986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:39.824986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:39.824986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 534/1073] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:39.830294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:39.909981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:39.930680 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8b66-13f4-41cb-8f86-64a76cc2fb22 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:39.967113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:39.967688 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:39.967968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:39.968242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:39.968981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:39.969289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:39.970643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:39.982772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 540/1074] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:39.988117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:40.086301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a001e-e1a0-4129-8665-fe6d876090f6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:40.100475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:40.123147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:40.123938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:40.124218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:40.124487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:40.131175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:40.132607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:40.146409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:40.147429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:40.148337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 535/1075] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:40.154444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:40.259190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309af1f-eac7-4c81-9fbc-a20019b38a26 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:40.292551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:40.294264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:40.294549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:40.294824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:40.295631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:40.295941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:40.297399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710d7e-d324-497c-93ee-f854a6ef6d36 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:40.306275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:40.312997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 541/1076] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:40.316618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:40.414039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb049452-04d9-4f72-94bc-a9ac067bee66 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:40.447055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4ff5-1be9-4ca8-925b-996383200fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:40.447937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4ff5-1be9-4ca8-925b-996383200fd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:40.448211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4ff5-1be9-4ca8-925b-996383200fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:40.448481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4ff5-1be9-4ca8-925b-996383200fd2 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/600d472e73da4c96af486c16a3f7df81/roles/82a2c22eda6f461e8c6db80c8c417c94` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:40.451215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4ff5-1be9-4ca8-925b-996383200fd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=600d472e73da4c96af486c16a3f7df81, role_id=82a2c22eda6f461e8c6db80c8c417c94)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:40.452633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4ff5-1be9-4ca8-925b-996383200fd2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:40.465875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 536/1077] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:40 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/600d472e73da4c96af486c16a3f7df81/roles/82a2c22eda6f461e8c6db80c8c417c94 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:40.673690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd43a0-b7e5-486c-b065-f78bda23c18f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:40.674044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd43a0-b7e5-486c-b065-f78bda23c18f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:40.674252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd43a0-b7e5-486c-b065-f78bda23c18f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:40.675652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 542/1078] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:40.681100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:40.681394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:40.681677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:40.698430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:40.700194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:40.725601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:40.768042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 537/1079] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:40.790255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd43a0-b7e5-486c-b065-f78bda23c18f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:40.891649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd43a0-b7e5-486c-b065-f78bda23c18f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:40.925942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:40.926661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:40.926947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:40.927221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:40.937720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:40.945541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:40.946704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:40.952590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 543/1080] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:40.953870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:41.051019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25121b-177c-4f9e-b9a3-6b87e41f0d30 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:41.085234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:41.085892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:41.086169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:41.086439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:41.087178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:41.087484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:41.088867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:41.097367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 538/1081] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:41.103214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:41.170057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:41.212254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036181ab-fb9f-47b2-b000-4a42fb303ff6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:41.245486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:41.246736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:41.246898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:41.247172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] PATH_INFO: `/v3/users/ee5c270180bd4b4e883a8a302618e15b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:41.248367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] RBAC: Authorizing `identity:get_user(user_id=ee5c270180bd4b4e883a8a302618e15b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:41.249848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:41.251470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 544/1082] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:41 2022] GET /identity/v3/users/ee5c270180bd4b4e883a8a302618e15b => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:41.257431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:41.283320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:41.358884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31842-06ec-42e4-b581-76a54e35955a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:41.391712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755c02-79c2-4a9c-920d-f452a67091c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:41.392563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755c02-79c2-4a9c-920d-f452a67091c1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:41.392880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755c02-79c2-4a9c-920d-f452a67091c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:41.393160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755c02-79c2-4a9c-920d-f452a67091c1 None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:41.394334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17755c02-79c2-4a9c-920d-f452a67091c1 None admin] RBAC: Authorizing `identity:get_project(project_id=51ba1212b56943efb78e8e5b41bc87fd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:41.395765 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17755c02-79c2-4a9c-920d-f452a67091c1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:41.397479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 539/1083] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:56:41 2022] GET /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:41.404359 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:41.503546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7af35-8377-433c-a616-412d5d1ac1bf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:41.529480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:41.537584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa03f15-dcaf-4418-890d-80554fe8c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:41.538498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa03f15-dcaf-4418-890d-80554fe8c8e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:41.538780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa03f15-dcaf-4418-890d-80554fe8c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:41.539055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa03f15-dcaf-4418-890d-80554fe8c8e4 None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd/users/ee5c270180bd4b4e883a8a302618e15b/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:41.541158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa03f15-dcaf-4418-890d-80554fe8c8e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ba1212b56943efb78e8e5b41bc87fd, user_id=ee5c270180bd4b4e883a8a302618e15b, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:41.542638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa03f15-dcaf-4418-890d-80554fe8c8e4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:41.557172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 545/1084] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:41 2022] PUT /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd/users/ee5c270180bd4b4e883a8a302618e15b/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:42.639472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030c123-0456-45b8-8020-6145f62856db None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:42.640034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030c123-0456-45b8-8020-6145f62856db None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:42.640132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030c123-0456-45b8-8020-6145f62856db None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:42.641525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 540/1085] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:42.647190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:42.647768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:42.647768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:42.665802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:42.666953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:42.738994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 546/1086] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:42.762502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030c123-0456-45b8-8020-6145f62856db None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:42.852308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:42.862246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030c123-0456-45b8-8020-6145f62856db None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:42.894438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:42.895175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:42.895453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:42.895723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:42.906597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:42.914598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:42.915712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:42.916856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 541/1087] 10.222.0.31 () {56 vars in 1120 bytes} [Wed May 25 16:56:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:42.921870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.017945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6629-d9d1-484e-b294-944f421bb476 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:43.034939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:43.052834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:43.053503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.053788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.054063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.054804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:43.055112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:43.056484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:43.065187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 547/1088] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:56:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:43.071749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.173214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9a1b1-af26-4959-9314-fe7401b479d4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:43.207439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:43.208236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.208520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.208835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.222530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:43.224000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:43.243835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:43.244993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:43.246745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:43.246745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:43.246745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:43.246745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:43.246745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 542/1089] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:56:43.251253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.352064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5b15c-1329-47ec-92fe-d33479f3c68b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:43.385198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:43.385853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.386138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.386412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.387753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:43.388144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:43.389537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:43.401213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 548/1090] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:43.406944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.410742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:43.507982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd1fa-79f2-4a02-90c8-05e7e907c6a2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:43.540321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:43.541132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.541422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.541700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.549721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:43.551159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:56:43.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:43.568355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:56:43.569365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:43.572931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 543/1091] 10.222.0.31 () {56 vars in 1093 bytes} [Wed May 25 16:56:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:43.575398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.618550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:43.676695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7b05-ff52-41f4-a676-384973c951dd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:43.711467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:43.712143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.712425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.712724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.713558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:43.713870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:43.716026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290421c-aff3-48a4-a7e1-fe3b1a7f59ae None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:43.733012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 549/1092] 10.222.0.31 () {56 vars in 1133 bytes} [Wed May 25 16:56:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:43.738727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.753008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1848-48c5-4a1a-97b5-57260cca0829 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.753294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1848-48c5-4a1a-97b5-57260cca0829 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.753569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1848-48c5-4a1a-97b5-57260cca0829 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.754898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 550/1093] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:56:43.759795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.760020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.760295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.778141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:43.779307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:43.802529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:43.841562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e93d-c55a-4ed5-838e-59f8ef2c4de6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:43.845337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 551/1094] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:43.868265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:43.874864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:43.875517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:43.875799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:43.876072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:43.895732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:43.944069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:43.945564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:43.966806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155e13a-5fa6-4940-b57d-45f39b145006 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.000573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.001376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.001652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.001924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.004729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.012399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:56:44.019934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:44.020898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:56:44.021874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 552/1095] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:56:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:44.027010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.045854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 544/1096] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:56:44.051462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.114995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.127272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9151bd-d864-4edf-8497-00ef3d996052 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.148960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3653b-0872-4d78-9f0f-51c6ee15b8c7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.160261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.160967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.161250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.161528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.162268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:44.162575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.163952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.172144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 553/1097] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:44.177710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.182180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.182966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.183249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.184053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.194265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.195707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:56:44.212895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:44.213967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:44.214954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:56:44.214954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:56:44.214954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:56:44.214954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:44.214954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 545/1098] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:44.219799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.237881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.282492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5fc5-e6b4-492e-aa83-bc00ea800115 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.317724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.318595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.318878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.319161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] PATH_INFO: `/v3/users/ee5c270180bd4b4e883a8a302618e15b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.320350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] RBAC: Authorizing `identity:get_user(user_id=ee5c270180bd4b4e883a8a302618e15b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.321813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.323463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 554/1099] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/users/ee5c270180bd4b4e883a8a302618e15b => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:44.325824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1b736-c3bc-4071-8c2d-840a03ece904 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.329044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.347449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.361107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.361786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.362074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.362357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.363080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:44.363387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.365984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.377969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 546/1100] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:44.383269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.431664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9339b6-2b34-441e-947a-679e5c701e32 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.459729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.467696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.468351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.468895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.469011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.483549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614cb84-7e6c-4db8-ade4-5d416b7cc0cc None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.517747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.518535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.518821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.519096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.525728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.527724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.538818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.540230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:56:44.541743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:56:44.542587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:56:44.543747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 547/1101] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:56:44.548773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.558632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.642113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 555/1102] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:44.647813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.648027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9343c-6151-4f9e-b82c-73fd7d65f764 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.686432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.687353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.687640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.687918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.688732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:44.689048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.690503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.693068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.703994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 548/1103] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:44.710089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.750741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f415b-6f67-46c5-b5a1-404161c67f0c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.768783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:44.786517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.787378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.787660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.787937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.789195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] RBAC: Authorizing `identity:get_project(project_id=51ba1212b56943efb78e8e5b41bc87fd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.790577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.792262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 556/1104] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:44.798211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:44.812127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464eda-0de7-44b1-8846-55c36daff1e8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.847131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.847782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.848067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.848345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.849338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] RBAC: Adding query filter params (role.id=82a2c22eda6f461e8c6db80c8c417c94, scope.project.id=081f5d965327435dba6971aab789335e, user.id=600d472e73da4c96af486c16a3f7df81) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:44.849653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.851095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc8938-2be8-4f13-8904-e48693b96ad8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.856782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 549/1105] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/role_assignments?user.id=600d472e73da4c96af486c16a3f7df81&scope.project.id=081f5d965327435dba6971aab789335e&role.id=82a2c22eda6f461e8c6db80c8c417c94 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:44.900299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1c590-3e21-4d5d-8fc5-968cffd45206 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:44.939549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:44.940220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:44.940504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:44.940880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:44.941736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=51ba1212b56943efb78e8e5b41bc87fd, user.id=ee5c270180bd4b4e883a8a302618e15b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:44.942054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:44.943543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a86ff-76bf-4393-873b-48347c052269 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:44.960720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 557/1106] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:44 2022] GET /identity/v3/role_assignments?user.id=ee5c270180bd4b4e883a8a302618e15b&scope.project.id=51ba1212b56943efb78e8e5b41bc87fd&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:56:47.211140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735088f2-7d02-4537-9756-83796c3c34ec None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:47.211680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735088f2-7d02-4537-9756-83796c3c34ec None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:47.211680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735088f2-7d02-4537-9756-83796c3c34ec None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:47.213234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 550/1107] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:47.219602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:47.220048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:47.220164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:47.238138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:47.239342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:47.289055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:47.312076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 558/1108] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:47.337008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735088f2-7d02-4537-9756-83796c3c34ec None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:47.405780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:47.453001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735088f2-7d02-4537-9756-83796c3c34ec None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:47.492438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677369d-aaf9-4ead-8c2f-f96459444af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:47.493650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677369d-aaf9-4ead-8c2f-f96459444af1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:47.494125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677369d-aaf9-4ead-8c2f-f96459444af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:47.494592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677369d-aaf9-4ead-8c2f-f96459444af1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:47.496329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677369d-aaf9-4ead-8c2f-f96459444af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:47.498485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677369d-aaf9-4ead-8c2f-f96459444af1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:47.500419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 551/1109] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:47.506008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:47.619489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f298-f582-4a49-85da-99c2336a0950 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:47.662229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0fd5-fcd5-4ea6-8521-04b9f2145c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:47.662901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0fd5-fcd5-4ea6-8521-04b9f2145c7c None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:47.663179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0fd5-fcd5-4ea6-8521-04b9f2145c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:47.663454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0fd5-fcd5-4ea6-8521-04b9f2145c7c None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:47.664163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd0fd5-fcd5-4ea6-8521-04b9f2145c7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:47.665634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd0fd5-fcd5-4ea6-8521-04b9f2145c7c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:47.692831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 559/1110] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:56:47 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:56:49.939862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0972-7167-4e48-b3ea-c3893bac3625 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:49.940364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0972-7167-4e48-b3ea-c3893bac3625 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:49.940364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0972-7167-4e48-b3ea-c3893bac3625 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:49.941712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 552/1111] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:49.946854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:49.947279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:49.947417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:49.963801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:49.965924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:49.994536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:50.032993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 560/1112] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:50.056728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c0972-7167-4e48-b3ea-c3893bac3625 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:50.156636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c0972-7167-4e48-b3ea-c3893bac3625 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:50.182486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:50.190699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:50.191494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:50.191771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:50.192043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] PATH_INFO: `/v3/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:50.193516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] RBAC: Authorizing `identity:get_role(role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:50.194871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:50.196215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 553/1113] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:50 2022] GET /identity/v3/roles/f9187cfd078c4241b44e62a19296c815 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:50.203124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:50.299812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68baeb-730a-49f4-b90a-75e634821b18 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:50.334101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:50.334954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:50.335240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:50.335519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] PATH_INFO: `/v3/users/d8c2f7e74dd4444584b368ff67450625` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:50.348995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] RBAC: Authorizing `identity:get_user(user_id=d8c2f7e74dd4444584b368ff67450625)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:50.350438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:50.352063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 561/1114] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:50 2022] GET /identity/v3/users/d8c2f7e74dd4444584b368ff67450625 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:50.357939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:50.455220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2e95-fd92-4bd7-88f9-4e581991760c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:50.487913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:50.488568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:50.488904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:50.489177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:50.547492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:50.553927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:50.555378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:50.650538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 554/1115] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:56:50.656397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:50.681160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:50.755750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17e4a-1bab-45dd-be94-7710cb66dfc0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:50.788719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabe15-a6b5-4f18-9d72-11fbd361f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:50.789576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabe15-a6b5-4f18-9d72-11fbd361f193 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:50.789862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabe15-a6b5-4f18-9d72-11fbd361f193 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:50.790140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabe15-a6b5-4f18-9d72-11fbd361f193 None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:50.791310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabe15-a6b5-4f18-9d72-11fbd361f193 None admin] RBAC: Authorizing `identity:get_project(project_id=51ba1212b56943efb78e8e5b41bc87fd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:50.793257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabe15-a6b5-4f18-9d72-11fbd361f193 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:50.795003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 562/1116] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:56:50 2022] GET /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:50.801201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:50.893422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:50.899248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7180-e4d6-4217-9305-31ef3b98ef23 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:50.932269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:50.932943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:50.933924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:50.934209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:50.935040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] RBAC: Adding query filter params (role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=51ba1212b56943efb78e8e5b41bc87fd, user.id=d8c2f7e74dd4444584b368ff67450625) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:50.935353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:50.937066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8376a-6f14-41cc-887f-e32cb75c5525 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:50.942343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 555/1117] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:50 2022] GET /identity/v3/role_assignments?user.id=d8c2f7e74dd4444584b368ff67450625&scope.project.id=51ba1212b56943efb78e8e5b41bc87fd&role.id=f9187cfd078c4241b44e62a19296c815 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:53.098959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2142a04-eb9c-43d1-b29b-d233557db40f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:53.099490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2142a04-eb9c-43d1-b29b-d233557db40f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:53.099490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2142a04-eb9c-43d1-b29b-d233557db40f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:53.101002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 563/1118] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:53.106312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:53.106717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:53.106863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:53.123607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:53.124799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:53.188511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 556/1119] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:56:53.211992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2142a04-eb9c-43d1-b29b-d233557db40f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:53.306547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:53.317832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2142a04-eb9c-43d1-b29b-d233557db40f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:53.350638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:53.351418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:53.351701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:53.351979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] PATH_INFO: `/v3/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:53.353462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] RBAC: Authorizing `identity:get_role(role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:53.355360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:53.356807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 564/1120] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:53 2022] GET /identity/v3/roles/f9187cfd078c4241b44e62a19296c815 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:53.362655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:53.451691 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:53.461464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c458f08-3f81-4b01-9713-663dba9f6f68 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:53.494701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:53.496123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:53.496408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:53.496702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] PATH_INFO: `/v3/users/d8c2f7e74dd4444584b368ff67450625` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:53.497884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] RBAC: Authorizing `identity:get_user(user_id=d8c2f7e74dd4444584b368ff67450625)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:53.499312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:53.500975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 557/1121] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:53 2022] GET /identity/v3/users/d8c2f7e74dd4444584b368ff67450625 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:53.506840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:53.602899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fba789-7e41-4207-9ce1-1d14f973d311 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:53.639745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8595bd9-bc11-41f0-96b9-30e727276a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:53.640596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8595bd9-bc11-41f0-96b9-30e727276a73 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:53.640902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8595bd9-bc11-41f0-96b9-30e727276a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:53.641175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8595bd9-bc11-41f0-96b9-30e727276a73 None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:53.642335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8595bd9-bc11-41f0-96b9-30e727276a73 None admin] RBAC: Authorizing `identity:get_project(project_id=51ba1212b56943efb78e8e5b41bc87fd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:53.643761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8595bd9-bc11-41f0-96b9-30e727276a73 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:53.645458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 565/1122] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:56:53 2022] GET /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:53.651407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:53.749051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdc7a5-1364-4d66-9538-36b667bcc785 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:53.781753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df228f-b793-4a84-a0e6-7412889adb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:53.782636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df228f-b793-4a84-a0e6-7412889adb77 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:53.782918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df228f-b793-4a84-a0e6-7412889adb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:53.783192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df228f-b793-4a84-a0e6-7412889adb77 None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd/users/d8c2f7e74dd4444584b368ff67450625/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:53.785374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df228f-b793-4a84-a0e6-7412889adb77 None admin] RBAC: Authorizing `identity:create_grant(project_id=51ba1212b56943efb78e8e5b41bc87fd, user_id=d8c2f7e74dd4444584b368ff67450625, role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:53.786872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df228f-b793-4a84-a0e6-7412889adb77 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:53.799809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 558/1123] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:56:53 2022] PUT /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd/users/d8c2f7e74dd4444584b368ff67450625/roles/f9187cfd078c4241b44e62a19296c815 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:56:55.985332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65d5f3-1adf-41dc-a24b-c87ae3abc4ea None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:55.985852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65d5f3-1adf-41dc-a24b-c87ae3abc4ea None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:55.985852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65d5f3-1adf-41dc-a24b-c87ae3abc4ea None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:55.987142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 566/1124] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:55.992338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:55.992751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:55.992920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:56.009801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:56.011070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:56.024270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:56.078441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 559/1125] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:56.101895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65d5f3-1adf-41dc-a24b-c87ae3abc4ea None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:56.129514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:56.202180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65d5f3-1adf-41dc-a24b-c87ae3abc4ea None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:56.234750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:56.235630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:56.235861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:56.236136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] PATH_INFO: `/v3/roles/f9187cfd078c4241b44e62a19296c815` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:56.237604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] RBAC: Authorizing `identity:get_role(role_id=f9187cfd078c4241b44e62a19296c815)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:56.238963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:56.240291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 567/1126] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:56 2022] GET /identity/v3/roles/f9187cfd078c4241b44e62a19296c815 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:56.246715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:56.341310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf663e-d5d3-4f0f-afd8-0c69f2af694f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:56.374487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:56.375341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:56.375622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:56.375896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] PATH_INFO: `/v3/users/d8c2f7e74dd4444584b368ff67450625` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:56.377078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] RBAC: Authorizing `identity:get_user(user_id=d8c2f7e74dd4444584b368ff67450625)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:56.378496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:56.380092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 560/1127] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:56:56 2022] GET /identity/v3/users/d8c2f7e74dd4444584b368ff67450625 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:56.385901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:56.478593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:56.485477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bb0b1-1349-4cd2-87a3-793facafe834 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:56.518945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:56.519525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:56.519808 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:56.520083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:56.586807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:56.588239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:56.679493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:56.687223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 568/1128] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:56:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:56:56.693062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:56.710867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:56.790720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c43ea-611d-41c4-9664-8fb8fcd3e844 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:56.824580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e6c4b-21e2-4ce5-88f9-f004ec32a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:56.825450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e6c4b-21e2-4ce5-88f9-f004ec32a01c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:56.825725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e6c4b-21e2-4ce5-88f9-f004ec32a01c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:56.825989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e6c4b-21e2-4ce5-88f9-f004ec32a01c None admin] PATH_INFO: `/v3/projects/51ba1212b56943efb78e8e5b41bc87fd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:56.827142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e6c4b-21e2-4ce5-88f9-f004ec32a01c None admin] RBAC: Authorizing `identity:get_project(project_id=51ba1212b56943efb78e8e5b41bc87fd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:56.828578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e6c4b-21e2-4ce5-88f9-f004ec32a01c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:56.830263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 561/1129] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:56:56 2022] GET /identity/v3/projects/51ba1212b56943efb78e8e5b41bc87fd => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:56.836272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:56.933641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faab60-b3d0-425d-b751-3631d51a7392 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:56.967475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:56.968115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:56.968398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:56.968699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:56.969520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] RBAC: Adding query filter params (role.id=f9187cfd078c4241b44e62a19296c815, scope.project.id=51ba1212b56943efb78e8e5b41bc87fd, user.id=d8c2f7e74dd4444584b368ff67450625) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:56:56.969831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:56.971248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b342b2-3a0c-47a4-805b-86d47fd2092d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:56.976992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 569/1130] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:56:56 2022] GET /identity/v3/role_assignments?user.id=d8c2f7e74dd4444584b368ff67450625&scope.project.id=51ba1212b56943efb78e8e5b41bc87fd&role.id=f9187cfd078c4241b44e62a19296c815 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:59.204232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2724-b8fd-40e9-9e41-ddd633bc16e1 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:59.204780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2724-b8fd-40e9-9e41-ddd633bc16e1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:59.204896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2724-b8fd-40e9-9e41-ddd633bc16e1 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:59.206183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 562/1131] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:56:59.211418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:59.211812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:59.211971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:59.228965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:56:59.230201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:56:59.283727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:59.294801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 570/1132] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:56:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:56:59.318257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2724-b8fd-40e9-9e41-ddd633bc16e1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:59.402966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:56:59.419342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2724-b8fd-40e9-9e41-ddd633bc16e1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:59.453333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac8349-7a96-4dde-8ee5-b3f5d8ef5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:59.454115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac8349-7a96-4dde-8ee5-b3f5d8ef5348 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:59.454443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac8349-7a96-4dde-8ee5-b3f5d8ef5348 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:59.454665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac8349-7a96-4dde-8ee5-b3f5d8ef5348 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:59.455820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac8349-7a96-4dde-8ee5-b3f5d8ef5348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:59.457284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac8349-7a96-4dde-8ee5-b3f5d8ef5348 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:59.458877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 563/1133] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:56:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:56:59.465578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:56:59.561757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ba68e-1558-44ba-acbc-a60124b8e5f8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:56:59.594631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631053a-edf5-4138-b2e2-dcbc0380bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:56:59.595275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631053a-edf5-4138-b2e2-dcbc0380bd84 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:56:59.595554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631053a-edf5-4138-b2e2-dcbc0380bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:56:59.595826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631053a-edf5-4138-b2e2-dcbc0380bd84 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:56:59.596524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631053a-edf5-4138-b2e2-dcbc0380bd84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:56:59.597972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631053a-edf5-4138-b2e2-dcbc0380bd84 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:56:59.622378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 571/1134] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:56:59 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:57:01.880643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d07-a100-4212-9de3-b287327a3f6d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:01.881246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d07-a100-4212-9de3-b287327a3f6d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:01.881246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d07-a100-4212-9de3-b287327a3f6d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:01.882571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 564/1135] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:01.888356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:01.888806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:01.888945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:01.907073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:01.908253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:01.943521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:01.975972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 572/1136] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:02.002044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d07-a100-4212-9de3-b287327a3f6d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:02.100452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d07-a100-4212-9de3-b287327a3f6d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:02.132967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ebc3f-713a-47c3-9ef1-63b2ffa4053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:02.133743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ebc3f-713a-47c3-9ef1-63b2ffa4053a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:02.134023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ebc3f-713a-47c3-9ef1-63b2ffa4053a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:02.134293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ebc3f-713a-47c3-9ef1-63b2ffa4053a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:02.135439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ebc3f-713a-47c3-9ef1-63b2ffa4053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:02.137054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ebc3f-713a-47c3-9ef1-63b2ffa4053a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:02.138631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 565/1137] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:02.144297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:02.245571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dfc20-a41d-4aac-96cf-2eb99617d032 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:02.281901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d48c4-d9ce-4a00-b79a-455b7cc8f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:02.282560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d48c4-d9ce-4a00-b79a-455b7cc8f688 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:02.282847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d48c4-d9ce-4a00-b79a-455b7cc8f688 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:02.283125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d48c4-d9ce-4a00-b79a-455b7cc8f688 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:02.283836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d48c4-d9ce-4a00-b79a-455b7cc8f688 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:02.285306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d48c4-d9ce-4a00-b79a-455b7cc8f688 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:02.304639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 573/1138] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:57:02 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:57:04.552960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea956-83df-4ef1-9243-d91e19d1f435 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:04.553516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea956-83df-4ef1-9243-d91e19d1f435 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:04.553516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea956-83df-4ef1-9243-d91e19d1f435 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:04.554860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 566/1139] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:04.560453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:04.560877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:04.561028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:04.578084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:04.579240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:04.601553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:04.644321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 574/1140] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:57:04.668183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea956-83df-4ef1-9243-d91e19d1f435 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:04.690324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:04.770581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea956-83df-4ef1-9243-d91e19d1f435 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:04.804183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:04.804930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:04.805216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:04.805491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:04.815970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:57:04.824488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:04.825730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:57:04.826850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 567/1141] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:57:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:57:04.831610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:04.928374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8e97c-dd1e-4ecc-a012-a6a34ede8754 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:04.970462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:04.971132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:04.971415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:04.971690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:04.972434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:04.972835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:04.974200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:04.982424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 575/1142] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:57:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:04.988313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:05.067823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:05.087430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5737f-ed19-4713-b85c-869844c882b5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:05.119712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:05.121214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:05.121492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:05.121761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] PATH_INFO: `/v3/users/1235da0fa041404782530b9ac8c91289` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:05.134490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1235da0fa041404782530b9ac8c91289)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:05.136571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:05.138209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 568/1143] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:57:04 2022] GET /identity/v3/users/1235da0fa041404782530b9ac8c91289 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:05.143928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:05.165488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:05.243216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd799d-9cc4-4eb5-8abe-315975b320ac None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:05.275817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:05.276481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:05.276878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:05.277159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:05.347610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:05.349015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:05.369207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:05.449836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 576/1144] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:57:05.455720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:05.554536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efb9ab-9968-4315-bf31-7060a434d2d7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:05.587985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b16e1-e78c-41e8-8afd-0462d82b7ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:05.589367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b16e1-e78c-41e8-8afd-0462d82b7ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:05.589680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b16e1-e78c-41e8-8afd-0462d82b7ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:05.590022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b16e1-e78c-41e8-8afd-0462d82b7ac7 None admin] PATH_INFO: `/v3/projects/57b917be4a434f128016b7201f6fa0d3` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:05.591204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b16e1-e78c-41e8-8afd-0462d82b7ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=57b917be4a434f128016b7201f6fa0d3)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:05.592644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b16e1-e78c-41e8-8afd-0462d82b7ac7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:05.594360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 569/1145] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:57:05 2022] GET /identity/v3/projects/57b917be4a434f128016b7201f6fa0d3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:05.600703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:05.700255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df234f-7b9e-4b71-b9ad-338a20814116 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:05.720876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:05.735930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:05.736576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:05.736881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:05.737156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:05.737979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=57b917be4a434f128016b7201f6fa0d3, user.id=1235da0fa041404782530b9ac8c91289) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:05.738290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:05.739713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce2d6-9bb6-4e76-b433-4b6bf8909047 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:05.745400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 577/1146] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:57:05 2022] GET /identity/v3/role_assignments?user.id=1235da0fa041404782530b9ac8c91289&scope.project.id=57b917be4a434f128016b7201f6fa0d3&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:07.887438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db4e5-9081-4423-8778-470536e5614d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:07.887987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db4e5-9081-4423-8778-470536e5614d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:07.887987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71db4e5-9081-4423-8778-470536e5614d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:07.889356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 570/1147] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:07.894528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:07.894963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:07.895089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:07.912467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:07.913689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:07.977860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 578/1148] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:08.000362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71db4e5-9081-4423-8778-470536e5614d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:08.012087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:08.103564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71db4e5-9081-4423-8778-470536e5614d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:08.136600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:08.137409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:08.137689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:08.137957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:08.147594 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:57:08.155177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:08.156288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:57:08.157395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 571/1149] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:57:08.162350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:08.261419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e64ef-47de-4ec5-b8d4-7ff6ad6dbbc8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:08.274663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:08.295299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:08.295954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:08.296238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:08.296514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:08.297283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:08.297591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:08.298963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:08.306939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 579/1150] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:08.313918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:08.378175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:08.412223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87738c-b483-4580-ac1c-6b78e6f4147e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:08.446018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:08.446883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:08.447165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:08.447440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] PATH_INFO: `/v3/users/1235da0fa041404782530b9ac8c91289` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:08.448667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] RBAC: Authorizing `identity:get_user(user_id=1235da0fa041404782530b9ac8c91289)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:08.450146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:08.451790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 572/1151] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:57:08 2022] GET /identity/v3/users/1235da0fa041404782530b9ac8c91289 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:08.457459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:08.554641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41f196-378d-4a35-87ed-4a4ec01c4907 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:08.587611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21510968-cdeb-4e0f-b891-c9db06fe7638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:08.588457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21510968-cdeb-4e0f-b891-c9db06fe7638 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:08.589299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21510968-cdeb-4e0f-b891-c9db06fe7638 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:08.589572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21510968-cdeb-4e0f-b891-c9db06fe7638 None admin] PATH_INFO: `/v3/projects/57b917be4a434f128016b7201f6fa0d3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:08.590744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21510968-cdeb-4e0f-b891-c9db06fe7638 None admin] RBAC: Authorizing `identity:get_project(project_id=57b917be4a434f128016b7201f6fa0d3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:08.592170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21510968-cdeb-4e0f-b891-c9db06fe7638 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:08.593857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 580/1152] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:57:08 2022] GET /identity/v3/projects/57b917be4a434f128016b7201f6fa0d3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:08.599674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:08.697956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317395b-50f3-4847-bbdd-7dada804ea3e None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:08.731892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def063d-6fa0-4d9c-95f2-40a32a988a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:08.732806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def063d-6fa0-4d9c-95f2-40a32a988a2a None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:08.733092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def063d-6fa0-4d9c-95f2-40a32a988a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:08.733368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def063d-6fa0-4d9c-95f2-40a32a988a2a None admin] PATH_INFO: `/v3/projects/57b917be4a434f128016b7201f6fa0d3/users/1235da0fa041404782530b9ac8c91289/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:08.735295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def063d-6fa0-4d9c-95f2-40a32a988a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=57b917be4a434f128016b7201f6fa0d3, user_id=1235da0fa041404782530b9ac8c91289, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:08.736753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def063d-6fa0-4d9c-95f2-40a32a988a2a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:08.738901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:08.750372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 573/1153] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:57:08 2022] PUT /identity/v3/projects/57b917be4a434f128016b7201f6fa0d3/users/1235da0fa041404782530b9ac8c91289/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:57:10.984818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487341d-c716-44f5-bb21-6ddd1981283e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:10.985336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487341d-c716-44f5-bb21-6ddd1981283e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:10.985336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487341d-c716-44f5-bb21-6ddd1981283e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:10.986655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 581/1154] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:10.991780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:10.992143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:10.992343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:11.009325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:11.011041 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:11.076790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 574/1155] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:11.100505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487341d-c716-44f5-bb21-6ddd1981283e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:11.146657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:11.201718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487341d-c716-44f5-bb21-6ddd1981283e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:11.234388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:11.235212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:11.235449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:11.235726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:11.246142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:57:11.253729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:11.254827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:57:11.256013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 582/1156] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:57:11.261372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:11.357046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e690b6-221a-4af8-997b-63197b783fbc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:11.379095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:11.390741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:11.391396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:11.391699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:11.391997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:11.392766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:11.393074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:11.394434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:11.403020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 575/1157] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:11.408894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:11.509617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980db9d-2515-408a-b316-2f6e2efc21b6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:11.512417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:11.546246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:11.548079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:11.548373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:11.548655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] PATH_INFO: `/v3/users/1235da0fa041404782530b9ac8c91289` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:11.549894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] RBAC: Authorizing `identity:get_user(user_id=1235da0fa041404782530b9ac8c91289)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:11.551327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:11.552982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 583/1158] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:57:11 2022] GET /identity/v3/users/1235da0fa041404782530b9ac8c91289 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:11.559491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:11.659961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7c485-28d2-4378-a3e3-c549fb5e7158 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:11.696001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:11.696645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:11.696952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:11.697235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:11.751873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:11.766211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:11.767627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:11.863050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 576/1159] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:57:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:57:11.868954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:11.965777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195ddb0-00ef-4a49-8f9c-fb5d81c98a3e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:11.999846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a089e26-292c-4a66-bdf4-cf09443636e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:12.000705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089e26-292c-4a66-bdf4-cf09443636e7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:12.000984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089e26-292c-4a66-bdf4-cf09443636e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:12.001254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089e26-292c-4a66-bdf4-cf09443636e7 None admin] PATH_INFO: `/v3/projects/57b917be4a434f128016b7201f6fa0d3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:12.002416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a089e26-292c-4a66-bdf4-cf09443636e7 None admin] RBAC: Authorizing `identity:get_project(project_id=57b917be4a434f128016b7201f6fa0d3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:12.003828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a089e26-292c-4a66-bdf4-cf09443636e7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:12.005502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 584/1160] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:57:11 2022] GET /identity/v3/projects/57b917be4a434f128016b7201f6fa0d3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:12.011658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:12.093223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:12.108640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a14dc-ada9-4e10-8e1a-8b0aa2cc187a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:12.141791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:12.142429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:12.142712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:12.142989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:12.143813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=57b917be4a434f128016b7201f6fa0d3, user.id=1235da0fa041404782530b9ac8c91289) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:12.144124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:12.145573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636a31-2c7c-48fc-95d8-9367ddcd0206 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:12.151427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 577/1161] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:57:12 2022] GET /identity/v3/role_assignments?user.id=1235da0fa041404782530b9ac8c91289&scope.project.id=57b917be4a434f128016b7201f6fa0d3&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:14.348940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d44d7-547d-4481-aa28-b61a0f6f3dd6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:14.349476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d44d7-547d-4481-aa28-b61a0f6f3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:14.349476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d44d7-547d-4481-aa28-b61a0f6f3dd6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:14.350836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 585/1162] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:14.356595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:14.357051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:14.357182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:14.374117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:14.375299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:14.439410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 578/1163] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:14.461796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d44d7-547d-4481-aa28-b61a0f6f3dd6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:14.504229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:14.562615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d44d7-547d-4481-aa28-b61a0f6f3dd6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:14.595627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:14.596255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:14.596534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:14.596836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:14.660957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:14.662324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:14.701557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:14.757879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 586/1164] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:57:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:57:14.763910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:14.841728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:14.861353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc5da-cc47-4df4-a6d4-72f64ad9cebe None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:14.893742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:14.894539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:14.894822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:14.895096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:14.902224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:14.903661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-acfc6e9e-1ab9-4716-8d3e-8efbc56e0ee5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:14.918301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:14.919527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:57:14.920564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 579/1165] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:57:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:57:14.925316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:15.020866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00b9ce-8281-45f8-9336-a3d853d99e63 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:15.053561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:15.054209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:15.054492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:15.054764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:15.055475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:15.055783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:15.057215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1508-12d4-4254-b171-72156bd75be2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:15.064370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 587/1166] 10.222.0.31 () {56 vars in 1115 bytes} [Wed May 25 16:57:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:17.264784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f849f-7694-4d7a-9314-ffcbeeeb06de None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:17.265310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f849f-7694-4d7a-9314-ffcbeeeb06de None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:17.265310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f849f-7694-4d7a-9314-ffcbeeeb06de None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:17.266713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 580/1167] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:17.271874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53e96-0b5b-4383-8a42-ae2bc434c26e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:17.272270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53e96-0b5b-4383-8a42-ae2bc434c26e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:17.272425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53e96-0b5b-4383-8a42-ae2bc434c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:17.279401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:17.290927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6be53e96-0b5b-4383-8a42-ae2bc434c26e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:17.292658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6be53e96-0b5b-4383-8a42-ae2bc434c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:17.357534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 588/1168] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:17.380663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f849f-7694-4d7a-9314-ffcbeeeb06de None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:17.480200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f849f-7694-4d7a-9314-ffcbeeeb06de None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:17.513210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76ce7e-121d-42d7-bae8-3f5428f0a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:17.513863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ce7e-121d-42d7-bae8-3f5428f0a785 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:17.514146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ce7e-121d-42d7-bae8-3f5428f0a785 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:17.514422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ce7e-121d-42d7-bae8-3f5428f0a785 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:17.515204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ce7e-121d-42d7-bae8-3f5428f0a785 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:17.516529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76ce7e-121d-42d7-bae8-3f5428f0a785 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:17.525185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:17.533813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 581/1169] 10.222.0.31 () {60 vars in 1138 bytes} [Wed May 25 16:57:17 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:57:19.798455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e7bf-4684-41b9-a0d6-51840e456e18 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:19.798969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e7bf-4684-41b9-a0d6-51840e456e18 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:19.799077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e7bf-4684-41b9-a0d6-51840e456e18 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:19.800356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 589/1170] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:19.805622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:19.806037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:19.806190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:19.824166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:19.825351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:19.889278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 582/1171] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:19.912834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e7bf-4684-41b9-a0d6-51840e456e18 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:20.010675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e7bf-4684-41b9-a0d6-51840e456e18 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:20.042746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7554-a0aa-4671-9324-5c103208fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:20.043598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7554-a0aa-4671-9324-5c103208fab2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:20.043881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7554-a0aa-4671-9324-5c103208fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:20.044157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7554-a0aa-4671-9324-5c103208fab2 None admin] PATH_INFO: `/v3/domains/abe6a91ea1a84f939681ff29131ce4b9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:20.046061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:20.055209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7554-a0aa-4671-9324-5c103208fab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=abe6a91ea1a84f939681ff29131ce4b9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:20.056642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7554-a0aa-4671-9324-5c103208fab2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:20.058810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 590/1172] 10.222.0.31 () {56 vars in 1183 bytes} [Wed May 25 16:57:19 2022] GET /identity/v3/domains/abe6a91ea1a84f939681ff29131ce4b9 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:20.064784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:20.159721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175241-8281-4297-98f6-22d0babe8eaf None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:20.187251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:20.193516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7123-721e-47af-9e7c-9da0b7dc6761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:20.194174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7123-721e-47af-9e7c-9da0b7dc6761 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:20.194461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7123-721e-47af-9e7c-9da0b7dc6761 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:20.194743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7123-721e-47af-9e7c-9da0b7dc6761 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:20.195444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7123-721e-47af-9e7c-9da0b7dc6761 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:20.197056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7123-721e-47af-9e7c-9da0b7dc6761 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:20.222094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 583/1173] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:57:20 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:57:22.451901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c9889-bb90-47e0-9020-6ad31f431ae8 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:22.452446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c9889-bb90-47e0-9020-6ad31f431ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:22.452446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c9889-bb90-47e0-9020-6ad31f431ae8 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:22.453976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 591/1174] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:22.459268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:22.459688 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:22.459826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:22.477443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:22.478693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:22.545990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 584/1175] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:22.571166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c9889-bb90-47e0-9020-6ad31f431ae8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:22.671878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c9889-bb90-47e0-9020-6ad31f431ae8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:22.705847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4e5a6-308f-4d76-8b69-c7ea41128013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:22.706647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e5a6-308f-4d76-8b69-c7ea41128013 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:22.706931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e5a6-308f-4d76-8b69-c7ea41128013 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:22.707208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e5a6-308f-4d76-8b69-c7ea41128013 None admin] PATH_INFO: `/v3/domains/abe6a91ea1a84f939681ff29131ce4b9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:22.708379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4e5a6-308f-4d76-8b69-c7ea41128013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=abe6a91ea1a84f939681ff29131ce4b9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:22.709842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4e5a6-308f-4d76-8b69-c7ea41128013 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:22.711440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 592/1176] 10.222.0.31 () {56 vars in 1183 bytes} [Wed May 25 16:57:22 2022] GET /identity/v3/domains/abe6a91ea1a84f939681ff29131ce4b9 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:22.717488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:22.813319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85f1d6-b104-4268-9f35-bcaefe39e754 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:22.826387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:22.848160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ba59d-bd3f-44f3-b82a-190ef63254c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:22.848850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba59d-bd3f-44f3-b82a-190ef63254c3 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:22.849131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba59d-bd3f-44f3-b82a-190ef63254c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:22.849402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba59d-bd3f-44f3-b82a-190ef63254c3 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:22.850150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ba59d-bd3f-44f3-b82a-190ef63254c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:22.851658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ba59d-bd3f-44f3-b82a-190ef63254c3 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:22.871798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 585/1177] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:57:22 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:57:25.123717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6575e-3e6e-49e1-ab00-c65a16cf8c73 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:25.124241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6575e-3e6e-49e1-ab00-c65a16cf8c73 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:25.124333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6575e-3e6e-49e1-ab00-c65a16cf8c73 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:25.125648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 593/1178] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:25.130822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:25.131181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:25.131382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:25.148283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:25.149497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:25.213975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 586/1179] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:25.237540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6575e-3e6e-49e1-ab00-c65a16cf8c73 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:25.298310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:25.338223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6575e-3e6e-49e1-ab00-c65a16cf8c73 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:25.371360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:25.372133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:25.372419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:25.372717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:25.382972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:57:25.391184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:25.392266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:57:25.393197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 594/1180] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:57:25.398302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:25.492032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:25.496555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be0412-f375-4d0d-a1f0-eca92b27ff28 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:25.533350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:25.534016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:25.534297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:25.534572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:25.535315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:25.535627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:25.537070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:25.545807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 587/1181] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:25.551613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:25.651774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1e313-ddbe-4f5a-94e8-24b7b8e9d2aa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:25.673997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:25.687117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:25.687996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:25.688280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:25.688557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] PATH_INFO: `/v3/users/67a5c126d3c54a9eb228a5a34bcf9c7e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:25.702315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] RBAC: Authorizing `identity:get_user(user_id=67a5c126d3c54a9eb228a5a34bcf9c7e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:25.703814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:25.705486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 595/1182] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:57:25 2022] GET /identity/v3/users/67a5c126d3c54a9eb228a5a34bcf9c7e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:25.711205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:25.813571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a874b-1710-4c29-b69a-451977bf57f0 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:25.846728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:25.847366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:25.847650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:25.847928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:25.878672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:25.920125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:25.921553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:26.019293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 588/1183] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:57:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:57:26.025866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:26.123843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ce39f-2e79-4aa7-8881-b673eab7e179 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:26.156651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775812d-d539-4e43-963e-dc97c6b5532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:26.157536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775812d-d539-4e43-963e-dc97c6b5532c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:26.157819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775812d-d539-4e43-963e-dc97c6b5532c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:26.158094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775812d-d539-4e43-963e-dc97c6b5532c None admin] PATH_INFO: `/v3/projects/da3bddea06cd4bd995b30e82299e850f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:26.159269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775812d-d539-4e43-963e-dc97c6b5532c None admin] RBAC: Authorizing `identity:get_project(project_id=da3bddea06cd4bd995b30e82299e850f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:26.160728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775812d-d539-4e43-963e-dc97c6b5532c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:26.162397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 596/1184] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:57:26 2022] GET /identity/v3/projects/da3bddea06cd4bd995b30e82299e850f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:26.169581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:26.226918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:26.267427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89966bb4-2cf7-44c2-bc56-40cb3dd32dd4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:26.300357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:26.301028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:26.301315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:26.301593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:26.302426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=da3bddea06cd4bd995b30e82299e850f, user.id=67a5c126d3c54a9eb228a5a34bcf9c7e) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:26.302743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:26.304178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a981456-9a39-4707-a7db-3e0d33fda8d0 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:26.309626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 589/1185] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:57:26 2022] GET /identity/v3/role_assignments?user.id=67a5c126d3c54a9eb228a5a34bcf9c7e&scope.project.id=da3bddea06cd4bd995b30e82299e850f&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:28.465980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0fd0-1ae9-4e4a-aa39-1bd989deea84 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:28.466512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0fd0-1ae9-4e4a-aa39-1bd989deea84 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:28.466512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0fd0-1ae9-4e4a-aa39-1bd989deea84 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:28.467865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 597/1186] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:28.473153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:28.473515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:28.473718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:28.490972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:28.492155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:28.558168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 590/1187] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:28.580857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0fd0-1ae9-4e4a-aa39-1bd989deea84 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:28.630270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:28.680749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0fd0-1ae9-4e4a-aa39-1bd989deea84 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:28.714385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:28.715169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:28.715454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:28.715732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:28.725779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:57:28.733962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:28.735063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:57:28.736076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 598/1188] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:57:28.741203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:28.795600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:28.840284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f4edc-01dd-4b27-910d-79edabaa02ac None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:28.873326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:28.873979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:28.874259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:28.874534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:28.875267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:28.875571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:28.876955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:28.884727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 591/1189] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:28.890654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:28.989828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bc5f-a30a-4bd6-857b-f1499afc5513 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:28.998202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:29.022511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:29.023373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:29.023651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:29.023920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] PATH_INFO: `/v3/users/67a5c126d3c54a9eb228a5a34bcf9c7e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:29.025626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] RBAC: Authorizing `identity:get_user(user_id=67a5c126d3c54a9eb228a5a34bcf9c7e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:29.027121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:29.028725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 599/1190] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:57:28 2022] GET /identity/v3/users/67a5c126d3c54a9eb228a5a34bcf9c7e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:29.034509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:29.133600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd7af-b6df-42de-a6a7-e0eb9321cdaf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:29.148990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:29.167931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85e985-9da7-4fe9-9d3c-1c7b7875cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:29.168813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e985-9da7-4fe9-9d3c-1c7b7875cb16 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:29.169097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e985-9da7-4fe9-9d3c-1c7b7875cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:29.169375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e985-9da7-4fe9-9d3c-1c7b7875cb16 None admin] PATH_INFO: `/v3/projects/da3bddea06cd4bd995b30e82299e850f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:29.170559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85e985-9da7-4fe9-9d3c-1c7b7875cb16 None admin] RBAC: Authorizing `identity:get_project(project_id=da3bddea06cd4bd995b30e82299e850f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:29.172009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85e985-9da7-4fe9-9d3c-1c7b7875cb16 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:29.173723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 592/1191] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:57:29 2022] GET /identity/v3/projects/da3bddea06cd4bd995b30e82299e850f => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:29.179660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:29.277248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf2ce-554f-46d3-8780-fce74b59ca29 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:29.309159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f14a7a-9c33-4e37-90a5-0eb0c895209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:29.310030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14a7a-9c33-4e37-90a5-0eb0c895209b None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:29.310316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14a7a-9c33-4e37-90a5-0eb0c895209b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:29.310591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14a7a-9c33-4e37-90a5-0eb0c895209b None admin] PATH_INFO: `/v3/projects/da3bddea06cd4bd995b30e82299e850f/users/67a5c126d3c54a9eb228a5a34bcf9c7e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:29.312826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f14a7a-9c33-4e37-90a5-0eb0c895209b None admin] RBAC: Authorizing `identity:create_grant(project_id=da3bddea06cd4bd995b30e82299e850f, user_id=67a5c126d3c54a9eb228a5a34bcf9c7e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:29.314247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f14a7a-9c33-4e37-90a5-0eb0c895209b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:29.326975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 600/1192] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:57:29 2022] PUT /identity/v3/projects/da3bddea06cd4bd995b30e82299e850f/users/67a5c126d3c54a9eb228a5a34bcf9c7e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:57:31.532245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b4efa-d227-4363-856b-2b1dcc70b9e8 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:31.532798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b4efa-d227-4363-856b-2b1dcc70b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:31.532798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b4efa-d227-4363-856b-2b1dcc70b9e8 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:31.534171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 593/1193] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:57:31.539582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:31.540017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:31.540147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:31.556659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:57:31.557867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:57:31.586106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:31.624665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 601/1194] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:57:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:57:31.648412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b4efa-d227-4363-856b-2b1dcc70b9e8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:31.755446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b4efa-d227-4363-856b-2b1dcc70b9e8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:31.788960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:31.789687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:31.789971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:31.790246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:31.800790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:57:31.811355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:57:31.812597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:57:31.813760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 594/1195] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:57:31.819556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:31.915764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ee604-58cc-429e-bdfd-4fa4145bc272 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:31.949713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:31.950370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:31.950659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:31.950938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:31.951678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:31.951989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:31.953425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:31.962016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 602/1196] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:31.968094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:32.013500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:32.067039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3433d-d6cc-45bd-89af-4620a4401083 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:32.100150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:32.101034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:32.101318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:32.101591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] PATH_INFO: `/v3/users/67a5c126d3c54a9eb228a5a34bcf9c7e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:32.102760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] RBAC: Authorizing `identity:get_user(user_id=67a5c126d3c54a9eb228a5a34bcf9c7e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:32.104723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:32.106331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 595/1197] 10.222.0.31 () {56 vars in 1177 bytes} [Wed May 25 16:57:31 2022] GET /identity/v3/users/67a5c126d3c54a9eb228a5a34bcf9c7e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:32.112104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:32.140919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:32.209578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c8b65-aca2-41aa-a76e-2cffa94d96c8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:32.241521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:32.242163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:32.242443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:32.242717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:32.308089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:32.309549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:32.334876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:32.404261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 603/1198] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:57:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:57:32.410235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:32.508698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f43e-c411-4500-824b-e4127ac1ef00 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:32.520924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:32.542123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d9ff6-ff81-42c9-93cb-d277b5605975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:32.542990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d9ff6-ff81-42c9-93cb-d277b5605975 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:32.543269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d9ff6-ff81-42c9-93cb-d277b5605975 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:32.543540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d9ff6-ff81-42c9-93cb-d277b5605975 None admin] PATH_INFO: `/v3/projects/da3bddea06cd4bd995b30e82299e850f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:32.544727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d9ff6-ff81-42c9-93cb-d277b5605975 None admin] RBAC: Authorizing `identity:get_project(project_id=da3bddea06cd4bd995b30e82299e850f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:32.546154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d9ff6-ff81-42c9-93cb-d277b5605975 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:32.547819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 596/1199] 10.222.0.31 () {56 vars in 1186 bytes} [Wed May 25 16:57:32 2022] GET /identity/v3/projects/da3bddea06cd4bd995b30e82299e850f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:32.553865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:57:32.651236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d28a7-350c-41e3-870c-da80c601aef8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:57:32.676785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:32.684650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:57:32.685324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:57:32.685602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:57:32.685874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:57:32.686954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=da3bddea06cd4bd995b30e82299e850f, user.id=67a5c126d3c54a9eb228a5a34bcf9c7e) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:57:32.687265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:57:32.688710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471938ff-01b2-4648-87ce-699761d0c640 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:57:32.694350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 604/1200] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:57:32 2022] GET /identity/v3/role_assignments?user.id=67a5c126d3c54a9eb228a5a34bcf9c7e&scope.project.id=da3bddea06cd4bd995b30e82299e850f&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:57:42.537980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=10 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:57:42.691749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:33.206714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403805-e6d5-496a-9ef6-4c6552aec947 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:33.207376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403805-e6d5-496a-9ef6-4c6552aec947 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:33.207488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403805-e6d5-496a-9ef6-4c6552aec947 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:33.209209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 597/1201] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:58:33.215676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a058754-b727-4171-914c-ec944e75a505 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:33.216168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a058754-b727-4171-914c-ec944e75a505 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:33.216256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a058754-b727-4171-914c-ec944e75a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:33.234161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5a058754-b727-4171-914c-ec944e75a505 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:33.235365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5a058754-b727-4171-914c-ec944e75a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:58:33.318254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 605/1202] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:58:33.346055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35403805-e6d5-496a-9ef6-4c6552aec947 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:33.488257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35403805-e6d5-496a-9ef6-4c6552aec947 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:33.538399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:33.539246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:33.539519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:33.539800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:33.555607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:33.557192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:33.578195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:33.579322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:33.580293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:33.580293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:33.580293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:33.580293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:33.580293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 598/1203] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:33.587378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a058754-b727-4171-914c-ec944e75a505 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:33.721368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a058754-b727-4171-914c-ec944e75a505 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:33.761283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:33.768228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:33.769301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:33.769865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:33.770415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:33.771149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:33.771471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:33.772938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39a09b-93a4-4ae5-ac44-61e6e7d1bc9d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:33.788720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 606/1204] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:33.794523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:33.859527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:33.917736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa750-276a-4fc1-9dc0-356daa00b978 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:33.963299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a87676-392e-452d-8c60-e3cf2d1ed860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:33.964105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a87676-392e-452d-8c60-e3cf2d1ed860 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:33.964391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a87676-392e-452d-8c60-e3cf2d1ed860 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:33.964711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a87676-392e-452d-8c60-e3cf2d1ed860 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:33.965524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a87676-392e-452d-8c60-e3cf2d1ed860 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:33.967166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a87676-392e-452d-8c60-e3cf2d1ed860 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:34.002796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 599/1205] 10.222.0.31 () {60 vars in 1132 bytes} [Wed May 25 16:58:33 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:58:36.463902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ee49-2a62-488f-8a80-f6f1a07088f7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:36.464489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ee49-2a62-488f-8a80-f6f1a07088f7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:36.464489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ee49-2a62-488f-8a80-f6f1a07088f7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:36.466383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 607/1206] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:58:36.472574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:36.473069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:36.473156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:36.492875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:36.494176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:58:36.579932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 600/1207] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:58:36.607077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ee49-2a62-488f-8a80-f6f1a07088f7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:36.730691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ee49-2a62-488f-8a80-f6f1a07088f7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:36.770823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:36.771696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:36.772208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:36.772592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:36.785939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:58:36.795807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:36.797051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:58:36.798117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:36.800826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 608/1208] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:58:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:58:36.805010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:36.851031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:36.920605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adfe20-47b0-4c63-90d3-21f4381d7260 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:36.958847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:36.960272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:36.960618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:36.961022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:36.961928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:36.962369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:36.963917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:36.978082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 601/1209] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:36.991119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:37.052346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:37.108128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9d996-15ec-4777-95e6-184ae5fa7a0d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:37.148191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:37.149052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:37.149337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:37.149616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:37.161756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:37.163454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:37.184653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:37.185945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:37.186923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:37.186923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:37.186923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:37.186923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:37.188860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 609/1210] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:37.192762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:37.298357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:37.301756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94107-8b66-4c22-80ce-6e4c76d81131 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:37.348719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:37.349458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:37.349773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:37.350132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:37.351264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:37.351576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:37.353285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:37.367748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 602/1211] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:58:37.373158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:37.495066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b14f8-89ef-43b6-b518-7554e8c40c95 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:37.496663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:37.536884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:37.538518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:37.538810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:37.539066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:37.547973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:37.552056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:58:37.568565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:37.570178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:37.571140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 610/1212] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:37.576566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:37.705486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17670232-8e6e-43b7-991c-4bb607b0e7c9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:37.747164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:37.747883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:37.748171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:37.748450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:37.749374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:37.749763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:37.751415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:37.773932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 603/1213] 10.222.0.31 () {56 vars in 1143 bytes} [Wed May 25 16:58:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:37.779413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:37.889487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55082-3db1-4414-b358-404f3e0c3003 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:37.934251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:37.935259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:37.935630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:37.935962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:37.973560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:38.026743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:38.028251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:38.140042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 611/1214] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:58:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:58:38.147378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:38.172558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:38.276658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32227458-0172-46e7-bf1b-d49a2a8ae090 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:38.326316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:38.327125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:38.327409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:38.327767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:38.340066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:38.341631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:38.360565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:38.361793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:38.362726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:38.362726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:38.362726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:38.362726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:38.362726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 604/1215] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:38.368105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:38.438788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:38.485823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5281f2-fc01-4389-92ba-9264385a6bd4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:38.535204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:38.535969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:38.536276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:38.536602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:38.537465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:38.537966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:38.539546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:38.554413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 612/1216] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:38.560284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:38.642642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:38.691531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711db0c-ee00-465a-9786-4c19313af0a6 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:38.729920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:38.731079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:38.731426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:38.731788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:38.739558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:38.741849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:58:38.761192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:38.762357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:38.763382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 605/1217] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:38.768729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:38.900180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71f49-489f-435b-be5e-8a6562f40714 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:38.926288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:38.941986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:38.942601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:38.942891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:38.943129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:38.946101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:38.946355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:38.947801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e093e-cb61-4f97-89a6-0898dcc39a82 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:38.960922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 613/1218] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:38.968562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:39.090929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61824-0286-4ca8-be25-6a545fe0e960 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:39.126357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:39.135069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:39.135824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:39.136171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:39.136367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:39.137343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=46555ca1a1404b94a39486d73a017f70) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:39.137705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:39.139291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec5fa-9f2e-4e0a-8a1c-ae1ba6ff76c1 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:39.146528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 606/1219] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:58:38 2022] GET /identity/v3/role_assignments?user.id=46555ca1a1404b94a39486d73a017f70&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:41.617732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe874ad-2737-4da1-b459-033ac5c5a7ae None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:41.618311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe874ad-2737-4da1-b459-033ac5c5a7ae None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:41.618311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe874ad-2737-4da1-b459-033ac5c5a7ae None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:41.619683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 614/1220] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:58:41.626097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:41.626633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:41.626633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:41.647775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:41.649112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:58:41.738136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 607/1221] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:58:41.762169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe874ad-2737-4da1-b459-033ac5c5a7ae None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:41.877377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe874ad-2737-4da1-b459-033ac5c5a7ae None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:41.913978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:41.914854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:41.915122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:41.915403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:41.925723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:58:41.933948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:41.935520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:41.936536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 615/1222] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:41.941638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:42.058847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a58b-c873-4536-a208-4cdd23be1b39 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:42.084847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:42.097627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:42.098300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:42.098585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:42.098861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:42.099612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] RBAC: Adding query filter params (name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:42.100462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:42.101874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:42.110838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 608/1223] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:42.117136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:42.164593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:42.223715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259fef3-7e8d-46d9-8e7b-debb7e40b0e8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:42.261926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:42.262727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:42.263009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:42.263282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:42.274467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:42.275906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:42.292697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:42.293784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:42.294821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:42.294821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:42.294821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:42.294821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:42.294821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 616/1224] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:42.299748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:42.413455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dbf02-83c9-4c02-94cc-5cd9378ed867 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:42.453352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:42.453889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:42.454218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:42.454491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:42.455203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:42.455609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:42.456909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:42.470427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 609/1225] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:42.477570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:42.576310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:42.583413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69c68-627b-4c5f-bb93-4451bdfa74c1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:42.620686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:42.621520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:42.621838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:42.622103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:42.629791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:42.631851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:58:42.647456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:42.648710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:42.649886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 617/1226] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:42.655213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:42.711175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:42.768997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a34bb-f792-4c68-9deb-1af43051097a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:42.803787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:42.804464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:42.804832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:42.805062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:42.806178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:42.806496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:42.808150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:42.829503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 610/1227] 10.222.0.31 () {56 vars in 1143 bytes} [Wed May 25 16:58:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:42.836293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:42.952200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9b032-78d8-47c8-8764-0133cdb5d9a3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:42.988532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:42.989270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:42.989556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:42.989887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:43.001902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:43.003382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:43.022166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:43.023316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:43.024433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:43.024433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:43.024433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:43.024433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:43.024433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 618/1228] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:43.029340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:43.142118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d543-c25b-4889-92fc-5e1e6afcadf4 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:43.144721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:43.182252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:43.183160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:43.183471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:43.183744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:43.184604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:43.185217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:43.186651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:43.198928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 611/1229] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:43.205211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:43.215515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:43.319341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec0301-3e69-493e-8495-a3f2db820904 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:43.361362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:43.362241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:43.362578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:43.362929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:43.378488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:43.379990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:58:43.395003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:43.396021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:43.397602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 619/1230] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:58:43.403093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:43.525916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d86aea-7353-479a-80c8-cc53ddb103c2 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:43.566637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:43.567427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:43.567728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:43.568004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:43.569535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:43.569803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:43.571262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb2e08-b3b6-4026-85b8-983c28c52033 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:43.585671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 612/1231] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:43.592329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:43.667049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:43.708279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5624-76a0-4e3a-a706-b42fed1f08e1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:43.749551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29237cc4-4198-4a9b-a230-127d6b596242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:43.750466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29237cc4-4198-4a9b-a230-127d6b596242 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:43.750823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29237cc4-4198-4a9b-a230-127d6b596242 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:43.751100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29237cc4-4198-4a9b-a230-127d6b596242 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/46555ca1a1404b94a39486d73a017f70/roles/b05cd888ee434bc9b2d4b6beebe69760` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:43.768120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29237cc4-4198-4a9b-a230-127d6b596242 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=46555ca1a1404b94a39486d73a017f70, role_id=b05cd888ee434bc9b2d4b6beebe69760)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:43.769718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29237cc4-4198-4a9b-a230-127d6b596242 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:43.784551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 620/1232] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:58:43 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/46555ca1a1404b94a39486d73a017f70/roles/b05cd888ee434bc9b2d4b6beebe69760 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:58:46.152939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2af72-3ee8-4046-a107-26cdc9a5d335 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:46.153634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2af72-3ee8-4046-a107-26cdc9a5d335 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:46.153634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2af72-3ee8-4046-a107-26cdc9a5d335 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:46.154868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 613/1233] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:58:46.160159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:46.160645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:46.160763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:46.177591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:46.179030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:58:46.250400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 621/1234] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:58:46.276373 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2af72-3ee8-4046-a107-26cdc9a5d335 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:46.305168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:46.389867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2af72-3ee8-4046-a107-26cdc9a5d335 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:46.428380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:46.428748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:46.429056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:46.429370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:46.441693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:58:46.450730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:46.451954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:46.452851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 614/1235] 10.222.0.31 () {56 vars in 1102 bytes} [Wed May 25 16:58:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:46.458281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:46.511925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:46.572641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3580067-e7b5-48de-9be9-a44a3e049ed3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:46.608997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:46.609635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:46.609917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:46.610191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:46.610936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:46.611242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:46.612608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:46.622353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 622/1236] 10.222.0.31 () {56 vars in 1103 bytes} [Wed May 25 16:58:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:46.628382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:46.727856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:46.747159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb44fcf-11e9-41ad-8c62-21dab7461efb None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:46.789537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:46.790339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:46.790620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:46.790891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:46.802322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:46.805010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:46.824287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:46.825471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:46.831665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:46.831665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:46.831665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:46.831665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:46.831665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 615/1237] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:46.832009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:46.939101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38cb8-1afc-45af-a151-e658608280c1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:46.949762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:46.979707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:46.980724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:46.981128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:46.981410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:46.982266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:46.982623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:46.984222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:46.997271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 623/1238] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:47.002838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:47.121163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111d13d-7475-45b5-baf3-301469018a49 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:47.158936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:47.159753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:47.160070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:47.160394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:47.163471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:47.169493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:47.171280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:58:47.187178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:47.188435 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:47.189815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 616/1239] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:47.194469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:47.307420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c727d8-8f0a-4367-8bf8-53ace5d0c63e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:47.347935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:47.348613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:47.348929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:47.349205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:47.350228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:47.350555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:47.352002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:47.371025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 624/1240] 10.222.0.31 () {56 vars in 1143 bytes} [Wed May 25 16:58:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:47.376857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:47.491145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2e3fb-3552-4ca5-9642-501089e8227b None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:47.528865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:47.529550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:47.529835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:47.530163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:47.596351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:47.603543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:47.605081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:47.713256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 617/1241] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:58:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:58:47.719410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:47.752008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:47.832174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cb284-668d-442d-9b55-331e5f3ff72e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:47.869386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:47.870258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:47.870594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:47.870945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:47.882397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:47.884029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:47.903743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:47.905119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:47.906040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:47.906040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:47.906040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:47.906040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:47.906040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 625/1242] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:47.910991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:48.017160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:48.024165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a3720-e7e8-472e-979e-65b04c0ee4af None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:48.064297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:48.064998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:48.065287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:48.065568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:48.066291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:48.066604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:48.068051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:48.081183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 618/1243] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:48.087716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:48.178194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:48.204510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81f98-c10a-49b0-bfd8-4798ba81a01e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:48.243775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:48.244613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:48.244922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:48.245227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:48.253204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:48.254631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:58:48.270855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:48.272158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:48.273379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 626/1244] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:48.279128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:48.394245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b3e37-8f03-45aa-a1e7-cabf7e26e0a8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:48.430391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:48.430962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:48.431245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:48.431520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:48.432309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:48.432622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:48.434084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a73980-2d81-4589-812f-9e834cf684e9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:48.453600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 619/1245] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:48.454995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:48.570263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1805d-1eb5-485a-85c8-a5d935cee023 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:48.605594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:48.606259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:48.606583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:48.606843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:48.607672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] RBAC: Adding query filter params (role.id=b05cd888ee434bc9b2d4b6beebe69760, scope.project.id=081f5d965327435dba6971aab789335e, user.id=46555ca1a1404b94a39486d73a017f70) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:48.608001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:48.609595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0cd73-a7a1-4c43-8688-3114f41f5f14 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:48.621689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 627/1246] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:58:48 2022] GET /identity/v3/role_assignments?user.id=46555ca1a1404b94a39486d73a017f70&scope.project.id=081f5d965327435dba6971aab789335e&role.id=b05cd888ee434bc9b2d4b6beebe69760 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:51.142909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d55a7e-7bac-446a-a5a4-a10cb3d771fc None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:51.143487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d55a7e-7bac-446a-a5a4-a10cb3d771fc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:51.143487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d55a7e-7bac-446a-a5a4-a10cb3d771fc None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:51.144863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 620/1247] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:58:51.151751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:51.152212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:51.152301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:51.157424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:51.172149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:51.173749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:58:51.252202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 628/1248] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:58:51.278917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d55a7e-7bac-446a-a5a4-a10cb3d771fc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:51.300694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:51.397044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d55a7e-7bac-446a-a5a4-a10cb3d771fc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:51.434985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:51.435910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:51.436262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:51.436607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:51.448802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:58:51.457762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:51.461012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:51.461991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 621/1249] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:51.466040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:51.582931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8941-3c3c-4e22-b0f3-d328662d89c4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:51.617035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:51.622748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:51.623416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:51.623704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:51.623978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:51.624757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:51.625061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:51.626487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:51.635463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 629/1250] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:58:51.641561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:51.736870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:51.764573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd844f13-9676-4290-87f0-ad3bd6b0afb8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:51.807837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:51.808631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:51.808942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:51.809239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:51.821679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:51.823136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:51.842994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:51.844103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:51.845044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:51.845044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:51.845044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:51.845044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:51.845044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 622/1251] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:51.850254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:51.965939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d657f4-06d2-435a-a94b-1213c721262c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:52.007243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:52.008014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:52.008352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:52.008710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:52.009476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:52.009842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:52.011551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:52.027645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 630/1252] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:52.036078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:52.149290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aca05-49b0-4161-8e8b-f010f3934d7a None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:52.180864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:52.189814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:52.190652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:52.190938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:52.191217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:52.200259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:52.201845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:58:52.217521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:52.224327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:52.225515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 623/1253] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:52.226105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:52.284957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:52.335467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0752-6dbc-4e26-8498-5a5ba4ed41a0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:52.374559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:52.375258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:52.375629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:52.375877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:52.376819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:52.377133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:52.378557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:52.397764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 631/1254] 10.222.0.31 () {56 vars in 1143 bytes} [Wed May 25 16:58:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:52.403424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:52.528740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffae14-c30f-494f-a158-bbc2b3d6f3b5 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:52.572219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:52.572911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:52.573219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:52.573522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:52.641593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:52.657739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:52.659242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:52.774274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 624/1255] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:58:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:58:52.780731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:52.890710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b2dce-078b-4007-bcea-78f11816ef6a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:52.904916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:52.927437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:52.928361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:52.928644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:52.928954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:52.939375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:52.940853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:52.961237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:52.962403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:52.963339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:52.963339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:52.963339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:52.963339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:52.963339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 632/1256] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:52.968636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:53.059175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:53.074662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f31c4b-6dd6-4661-9952-05367797c1dd None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:53.115846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:53.116554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:53.116903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:53.117302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:53.118166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:53.118606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:53.120455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:53.134526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 625/1257] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:53.140655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:53.253902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb49929-29ea-47b1-bac4-f6542f70b9e2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:53.292008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:53.292984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:53.293323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:53.293630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:53.301474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:53.304117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:58:53.319998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:53.321615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:58:53.323004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 633/1258] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:53.327772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:53.463866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e6cc-f3ae-49de-a2e6-7a28b6cd5954 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:53.510464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:53.510464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:53.510464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:53.510464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:53.510869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:53.511044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:53.512541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98b81d-de69-45a9-ae7a-9bf86e591371 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:53.526690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 626/1259] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:53.533411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:53.562780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:53.642601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8de1-18a9-40f9-8b25-db1df5f1943e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:53.684187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:53.685156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:53.685440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:53.685718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:53.686609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=081f5d965327435dba6971aab789335e, user.id=46555ca1a1404b94a39486d73a017f70) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:53.686925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:53.688394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426db1-6e4c-4ab0-9c02-655a811aa9dc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:53.695358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 634/1260] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:58:53 2022] GET /identity/v3/role_assignments?user.id=46555ca1a1404b94a39486d73a017f70&scope.project.id=081f5d965327435dba6971aab789335e&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:55.893094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71943d-4e36-4e3d-a0ac-3b30f7022947 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:55.893670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71943d-4e36-4e3d-a0ac-3b30f7022947 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:55.893670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71943d-4e36-4e3d-a0ac-3b30f7022947 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:55.895033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 627/1261] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:58:55.900882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:55.901281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:55.901448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:55.918486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:55.919665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:58:55.984175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 635/1262] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:58:56.007141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71943d-4e36-4e3d-a0ac-3b30f7022947 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:56.017818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:56.108130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71943d-4e36-4e3d-a0ac-3b30f7022947 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:56.140796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:56.141588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:56.141873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:56.142152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:56.156821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:58:56.165071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:56.166190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:56.171987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 628/1263] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:56.172869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:56.190430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:56.269346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903e50-a868-491a-88e8-370cf2282747 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:56.302601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:56.303243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:56.303519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:56.303788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:56.304516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:56.304850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:56.306197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:56.314599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 636/1264] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:56.320961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:56.388713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:56.422025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b68c2-a26c-4aae-bc6a-b912296729a8 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:56.456481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:56.457316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:56.457603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:56.457873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:56.471128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:56.472660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:56.491692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:56.492742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:56.493653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:56.493653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:56.493653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:56.493653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:56.493653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 629/1265] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:56.498863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:56.582429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:56.602070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce1510-9666-4be9-ba1a-3639d44d3864 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:56.635275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:56.635924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:56.636204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:56.636477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:56.637221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:56.637528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:56.638889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:56.651178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 637/1266] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:56.656911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:56.757694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc9c0-fdd0-417b-b1d1-6712f7b57b66 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:56.780083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:56.796071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:56.796910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:56.797193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:56.797597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:56.804974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:56.806411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:58:56.820756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:56.821879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:56.823140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 630/1267] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:56.827649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:56.925924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd2eb2-151c-4aa7-9558-04e165ec3180 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:56.961338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:56.961992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:56.962277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:56.962553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:56.963378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:56.963690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:56.965163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:56.973514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:56.981878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 638/1268] 10.222.0.31 () {56 vars in 1143 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:56.987464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:57.084954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb5b0c-3daa-42f1-ba1a-53afed9403fe None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:57.117792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:57.118580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:57.118862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:57.119137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:57.129642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:57.131985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:58:57.149607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:57.150661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:57.151630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:58:57.151630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:58:57.151630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:58:57.151630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:57.151630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 631/1269] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:57.156387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:57.253758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4812546-5f76-4d22-acd7-59c7924e727d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:57.287335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:57.287983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:57.288266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:57.288540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:57.289281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:57.289589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:57.290948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:57.301834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 639/1270] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:57.307400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:57.338816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:57.406452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b20b91-5880-49bc-957b-5380de1ed8d7 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:57.440069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:57.440938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:57.441269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:57.441577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:57.450524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:57.452032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:58:57.468362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:58:57.469475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:58:57.470780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 632/1271] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:58:57.476106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:57.534760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:57.577757 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98796-26a9-44c2-88ef-d9f30e0a26be None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:57.609848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:57.610489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:57.610763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:57.611034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:57.611796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:58:57.612100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:57.613622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffbfb6-62d3-45d0-bd7b-885f8a1ad451 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:57.625701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 640/1272] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:58:57.632323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:58:57.721317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:58:57.730693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c26899-75d4-4fbb-ac1f-324bd2451c06 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:58:57.763662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6515-764a-49bc-84e1-8236e99722e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:58:57.764537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6515-764a-49bc-84e1-8236e99722e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:57.764844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6515-764a-49bc-84e1-8236e99722e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:57.765120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6515-764a-49bc-84e1-8236e99722e7 None admin] PATH_INFO: `/v3/projects/081f5d965327435dba6971aab789335e/users/46555ca1a1404b94a39486d73a017f70/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:57.767033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6515-764a-49bc-84e1-8236e99722e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=081f5d965327435dba6971aab789335e, user_id=46555ca1a1404b94a39486d73a017f70, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:58:57.768465 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6515-764a-49bc-84e1-8236e99722e7 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:58:57.780714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 633/1273] 10.222.0.31 () {58 vars in 1439 bytes} [Wed May 25 16:58:57 2022] PUT /identity/v3/projects/081f5d965327435dba6971aab789335e/users/46555ca1a1404b94a39486d73a017f70/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:58:59.946588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcca6a-7930-4807-945e-8cce0b15e79f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:59.947085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcca6a-7930-4807-945e-8cce0b15e79f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:59.947085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcca6a-7930-4807-945e-8cce0b15e79f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:59.948411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 641/1274] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:58:59.953643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:58:59.954015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:58:59.954205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:58:59.971664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:58:59.972881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:59:00.039554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 634/1275] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:58:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:59:00.062515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcca6a-7930-4807-945e-8cce0b15e79f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:00.160175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcca6a-7930-4807-945e-8cce0b15e79f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:00.178245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:00.195431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:00.196213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:00.196492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:00.196845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:00.206495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:59:00.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:00.215169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:00.216070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 642/1276] 10.222.0.31 () {56 vars in 1096 bytes} [Wed May 25 16:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:00.221196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:00.301936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:00.321603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150f042-5583-4ff1-a9be-32e2b174bc0e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:00.355919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:00.356577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:00.356887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:00.357165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:00.357899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:00.358205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:00.359577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:00.367869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 635/1277] 10.222.0.31 () {56 vars in 1099 bytes} [Wed May 25 16:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:00.373517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:00.480009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d517d-72a9-459e-891e-df1a4b59a671 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:00.514859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:00.515652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:00.515944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:00.516222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:00.527242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:00.528699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:59:00.545391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:00.546444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:00.547557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:59:00.547557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:59:00.547557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:59:00.547557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:00.547557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 643/1278] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:00.552989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:00.650542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c9836-20ca-40a3-abee-73aacb2a0ecf None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:00.684095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:00.685055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:00.685361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:00.685664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:00.686387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:00.686692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:00.688057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:00.700511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 636/1279] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:00.706058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:00.737474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:00.807295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de479-f556-487a-ab39-142a1722f49e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:00.841088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:00.841877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:00.842164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:00.842439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:00.850646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:00.852078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:59:00.866844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:00.868002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:00.869002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 644/1280] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:59:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:00.873827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:00.877565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:00.972937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca741-1de1-4b56-9f80-036bf61f766c None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:01.006995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:01.007599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:01.007883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:01.008160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:01.009025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:01.009332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:01.010785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:01.027968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 637/1281] 10.222.0.31 () {56 vars in 1143 bytes} [Wed May 25 16:59:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:01.033683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:01.124271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:01.134465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e0d88-ccf6-4026-84d0-c37c6f372a2f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:01.167639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:01.168269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:01.168548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:01.168850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:01.234678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:01.236116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:01.320605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:01.330859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 645/1282] 10.222.0.31 () {58 vars in 1282 bytes} [Wed May 25 16:59:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:59:01.337409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:01.397902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:01.435783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5768910-bb64-407f-9c39-cd5d5eea2410 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:01.471170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:01.471965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:01.472248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:01.472525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:01.482413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:01.483873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:59:01.501200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:01.502229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:01.503345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:59:01.503345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:59:01.503345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:59:01.503345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:59:01.503345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 638/1283] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 16:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:01.509143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:01.607527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3d12f-945d-4346-a03a-94d3f86869e2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:01.641009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:01.641652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:01.641934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:01.642208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:01.642915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:01.643219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:01.644574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:01.656308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 646/1284] 10.222.0.31 () {56 vars in 1109 bytes} [Wed May 25 16:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:01.662777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:01.765871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1b3f-1f01-404f-a68f-0bd717ee07d9 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:01.779720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:01.816423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:01.817262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:01.817565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:01.817839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:01.824639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:01.826128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:59:01.845824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application with Lock( May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:01.847702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: ERROR keystone.server.flask.application May 25 16:59:01.849962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 639/1285] 10.222.0.31 () {56 vars in 1111 bytes} [Wed May 25 16:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:01.854651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:01.907876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:01.957361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d1e0-a5d1-4e7c-a0e5-ab747e910b1c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:01.997381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:01.998032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:01.998311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:01.998578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:01.999344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:01.999649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:02.001096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cdff0-cf48-4dd6-8790-ef1ff1371467 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:02.013679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 647/1286] 10.222.0.31 () {56 vars in 1148 bytes} [Wed May 25 16:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:02.019891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:02.118108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fde6-9fba-4454-9661-3ce859557142 None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:02.150310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:02.150952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:02.151236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:02.151514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:02.152340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] RBAC: Adding query filter params (role.id=bf0c64aece024dff9ecbdf6d367236fe, scope.project.id=081f5d965327435dba6971aab789335e, user.id=46555ca1a1404b94a39486d73a017f70) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:02.152656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:02.154110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70df8c-02d8-4e20-bf83-b43b5f5bc2e5 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:02.159811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 640/1287] 10.222.0.31 () {56 vars in 1374 bytes} [Wed May 25 16:59:02 2022] GET /identity/v3/role_assignments?user.id=46555ca1a1404b94a39486d73a017f70&scope.project.id=081f5d965327435dba6971aab789335e&role.id=bf0c64aece024dff9ecbdf6d367236fe => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:04.380703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfce7-7a62-4ebd-96ef-f6a001203fe2 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:04.381348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfce7-7a62-4ebd-96ef-f6a001203fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:04.381348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfce7-7a62-4ebd-96ef-f6a001203fe2 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:04.382612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 648/1288] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:59:04.387737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:04.388175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:04.388321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:04.404721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:59:04.405886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:59:04.434816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:04.477303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 641/1289] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:59:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:59:04.503279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfce7-7a62-4ebd-96ef-f6a001203fe2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:04.606211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfce7-7a62-4ebd-96ef-f6a001203fe2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:04.617646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:04.646408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:04.647272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:04.647558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:04.647832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:04.648486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:04.649896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:04.662640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:04.663890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:04.665240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 649/1290] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:59:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:04.669990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:04.766015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d581c1a-7f39-47b0-9c1e-124f8b747d36 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:04.798799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:04.799463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:04.799749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:04.800029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:04.800760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:04.801074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:04.803134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f90107-7457-4a66-83c3-eceab18bf928 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:04.807880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 642/1291] 10.222.0.31 () {56 vars in 1116 bytes} [Wed May 25 16:59:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:04.814005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:04.914216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7332-661d-4ec5-8e53-c96086bea4cc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:04.947735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:04.948467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:04.948724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:04.949002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:04.949694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:04.950001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:04.951353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109d68a-0845-41d9-a31c-4c4e7a367056 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:04.955677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 650/1292] 10.222.0.31 () {56 vars in 1116 bytes} [Wed May 25 16:59:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:07.122601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325f409-8ad6-4f01-9be2-07b0d4b95103 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:07.123147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325f409-8ad6-4f01-9be2-07b0d4b95103 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:07.123147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325f409-8ad6-4f01-9be2-07b0d4b95103 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:07.124504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 643/1293] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:59:07.130472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f7b9-8958-47ec-9549-b2ced5324b65 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:07.130865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f7b9-8958-47ec-9549-b2ced5324b65 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:07.131036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f7b9-8958-47ec-9549-b2ced5324b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:07.147437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2923f7b9-8958-47ec-9549-b2ced5324b65 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:59:07.148625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2923f7b9-8958-47ec-9549-b2ced5324b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:59:07.177574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:07.214362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 651/1294] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:59:07.236284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325f409-8ad6-4f01-9be2-07b0d4b95103 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:07.267102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:07.336450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325f409-8ad6-4f01-9be2-07b0d4b95103 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:07.369840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5d929-f888-4b52-bf3b-43026ef0cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:07.370491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d929-f888-4b52-bf3b-43026ef0cf21 None admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:07.370768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d929-f888-4b52-bf3b-43026ef0cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:07.371038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d929-f888-4b52-bf3b-43026ef0cf21 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:07.371748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5d929-f888-4b52-bf3b-43026ef0cf21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:07.373196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5d929-f888-4b52-bf3b-43026ef0cf21 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:07.386763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 644/1295] 10.222.0.31 () {60 vars in 1141 bytes} [Wed May 25 16:59:07 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:59:09.643439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ca8a5-cd71-4796-9d44-aa3646c620e9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:09.644003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ca8a5-cd71-4796-9d44-aa3646c620e9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:09.644171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ca8a5-cd71-4796-9d44-aa3646c620e9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:09.646333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 652/1296] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:59:09.652019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:09.652436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:09.652747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:09.669578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:59:09.670766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:59:09.742775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 645/1297] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:59:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:59:09.765193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ca8a5-cd71-4796-9d44-aa3646c620e9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:09.862215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ca8a5-cd71-4796-9d44-aa3646c620e9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:09.894957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:09.895779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:09.896058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:09.896326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:09.896992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:09.898343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:09.909782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:09.911461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:09.912474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 653/1298] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:59:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:09.917608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:09.937021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:10.017909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35dc19-940a-4a17-b3d6-1e6a2724ac48 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:10.050921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:10.052231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:10.052578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:10.052892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:10.053599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] RBAC: Adding query filter params (name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:10.053908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:10.055281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:10.060566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 646/1299] 10.222.0.31 () {56 vars in 1116 bytes} [Wed May 25 16:59:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:10.066483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:10.098143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:10.165579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae519-32e6-40fd-ac13-1d347c693d02 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:10.198307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:10.198952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:10.199250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:10.199515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:10.200292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] RBAC: Adding query filter params (interface=public, service_id=023f27ff94ee4c83b133219c6c054ec9, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:10.200606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:10.201993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19965ee-946a-4b27-9aff-74a3fa916b66 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:10.206914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 654/1300] 10.222.0.31 () {56 vars in 1251 bytes} [Wed May 25 16:59:10 2022] GET /identity/v3/endpoints?service_id=023f27ff94ee4c83b133219c6c054ec9&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:10.213031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:10.292930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:10.310809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a064-4540-4b8d-b114-4b7d78880dab None admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:10.343729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2150c48-034c-493f-9b65-c637fe61438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:10.344382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2150c48-034c-493f-9b65-c637fe61438d None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:10.344670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2150c48-034c-493f-9b65-c637fe61438d None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:10.344977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2150c48-034c-493f-9b65-c637fe61438d None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:10.345659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2150c48-034c-493f-9b65-c637fe61438d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:10.347025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2150c48-034c-493f-9b65-c637fe61438d None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:10.354618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 647/1301] 10.222.0.31 () {56 vars in 1087 bytes} [Wed May 25 16:59:10 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:59:12.536855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f4e2f-3069-4789-8ccb-48bc4fce9c56 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:12.537414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f4e2f-3069-4789-8ccb-48bc4fce9c56 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:12.537584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f4e2f-3069-4789-8ccb-48bc4fce9c56 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:12.538971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 655/1302] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 16:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:59:12.545018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:12.545454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:12.545586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:12.562532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:59:12.563702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:59:12.628907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 648/1303] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 16:59:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:59:12.652265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f4e2f-3069-4789-8ccb-48bc4fce9c56 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:12.748370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:12.756292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f4e2f-3069-4789-8ccb-48bc4fce9c56 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:12.789417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:12.790143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:12.790424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:12.790697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:12.791336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:12.792726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:59:12.804746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:59:12.805889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 25 16:59:12.806753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 656/1304] 10.222.0.31 () {56 vars in 1117 bytes} [Wed May 25 16:59:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:59:12.812251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:12.887818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:12.911467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d950f-03f0-4615-9ede-3b5dacc7f1c8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:12.945043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:12.945701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:12.945986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:12.946261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] PATH_INFO: `/v3/services` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:12.946958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:59:12.947266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:12.948636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54f60c-66b5-4abe-a212-50c10069e349 None admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:12.953693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 649/1305] 10.222.0.31 () {56 vars in 1116 bytes} [Wed May 25 16:59:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:59:12.959998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:59:13.056771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eb103-30f9-4ad0-8388-814c5db2efcc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:59:13.089836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7903ea-a8df-4d4d-be09-414b19901c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:59:13.090478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7903ea-a8df-4d4d-be09-414b19901c09 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:59:13.090760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7903ea-a8df-4d4d-be09-414b19901c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:59:13.091036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7903ea-a8df-4d4d-be09-414b19901c09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:59:13.091775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7903ea-a8df-4d4d-be09-414b19901c09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:59:13.093173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7903ea-a8df-4d4d-be09-414b19901c09 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:59:13.110442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 657/1306] 10.222.0.31 () {60 vars in 1144 bytes} [Wed May 25 16:59:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:59:22.950752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=30 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:59:23.106269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:16.891198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c1ff-a8ec-4f18-bcb3-8a45c9ae8c9e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:16.892345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c1ff-a8ec-4f18-bcb3-8a45c9ae8c9e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:16.892345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c1ff-a8ec-4f18-bcb3-8a45c9ae8c9e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:16.897988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 650/1307] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:16.899597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec103-9b5b-4990-8990-3eba6eea641e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:16.900444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec103-9b5b-4990-8990-3eba6eea641e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:16.900953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec103-9b5b-4990-8990-3eba6eea641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:16.999848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-456ec103-9b5b-4990-8990-3eba6eea641e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:17.001073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-456ec103-9b5b-4990-8990-3eba6eea641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:17.112207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 658/1308] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:00:17.165618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113453d-e5c2-4aac-ac11-cfe88f6d4c2e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:17.165937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113453d-e5c2-4aac-ac11-cfe88f6d4c2e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:17.166234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113453d-e5c2-4aac-ac11-cfe88f6d4c2e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:17.168029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 651/1309] 10.222.0.31 () {54 vars in 964 bytes} [Wed May 25 17:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:17.174858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7fff9-c893-4c2e-9749-cdc6a55a0a03 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:17.175554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7fff9-c893-4c2e-9749-cdc6a55a0a03 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:17.176449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7fff9-c893-4c2e-9749-cdc6a55a0a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:17.281060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-62c7fff9-c893-4c2e-9749-cdc6a55a0a03 None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:17.282281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-62c7fff9-c893-4c2e-9749-cdc6a55a0a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:17.307588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:17.368202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 659/1310] 10.222.0.31 () {58 vars in 1061 bytes} [Wed May 25 17:00:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:17.378127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113453d-e5c2-4aac-ac11-cfe88f6d4c2e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:17.379758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f113453d-e5c2-4aac-ac11-cfe88f6d4c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:17.524243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113453d-e5c2-4aac-ac11-cfe88f6d4c2e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:17.601476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:17.602129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:17.602410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:17.602679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:17.604360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:17.662384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:17.732081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:17.733491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545d6e1-290c-4f3e-a69e-a815823ecb9c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:17.753914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 652/1311] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:20.309964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8343f-3d73-4db3-ba2f-ab0a6e3b2a7a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:20.310518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8343f-3d73-4db3-ba2f-ab0a6e3b2a7a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:20.310518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8343f-3d73-4db3-ba2f-ab0a6e3b2a7a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:20.311912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 660/1312] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:20.318363 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27513-043c-4148-bd39-277e72619605 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:20.318910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27513-043c-4148-bd39-277e72619605 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:20.318910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27513-043c-4148-bd39-277e72619605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:20.404996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0dd27513-043c-4148-bd39-277e72619605 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:20.406253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0dd27513-043c-4148-bd39-277e72619605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:20.523529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 653/1313] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:20.562179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8343f-3d73-4db3-ba2f-ab0a6e3b2a7a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:20.563893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4fc8343f-3d73-4db3-ba2f-ab0a6e3b2a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:20.679636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8343f-3d73-4db3-ba2f-ab0a6e3b2a7a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:20.761897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:20.764083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:20.764842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:20.765504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:20.766113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:20.769042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:20.887297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:20.888771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8117b-07e5-47f6-9fd2-7e3ea4d5267e service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:20.910671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 661/1314] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:00:23.469423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2f854-e6fc-465a-a2f9-96fa67e298c1 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:23.469996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2f854-e6fc-465a-a2f9-96fa67e298c1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:23.469996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2f854-e6fc-465a-a2f9-96fa67e298c1 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:23.471877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 654/1315] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:23.477359 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89013bd-92a2-46a0-9f9e-6c08417b1fdb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:23.477782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89013bd-92a2-46a0-9f9e-6c08417b1fdb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:23.477932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89013bd-92a2-46a0-9f9e-6c08417b1fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:23.542505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f89013bd-92a2-46a0-9f9e-6c08417b1fdb None None] MFA Rules not processed for user `af2521f6f90246608eabb4e52c5296fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:23.543710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f89013bd-92a2-46a0-9f9e-6c08417b1fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:23.597167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:23.642670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 662/1316] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:00:23.690500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2f854-e6fc-465a-a2f9-96fa67e298c1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:23.692073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b0d2f854-e6fc-465a-a2f9-96fa67e298c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:23.701868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:23.797400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2f854-e6fc-465a-a2f9-96fa67e298c1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:23.869339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:23.869986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:23.870266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:23.870537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:23.872202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:23.932584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:23.979136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:23.980576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a832f4-f43f-4065-b8b3-0da514cde9a7 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:23.998929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 655/1317] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:26.829820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dec76e-d139-4f1d-ad5d-f06d46cf8d93 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:26.829820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dec76e-d139-4f1d-ad5d-f06d46cf8d93 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:26.830446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dec76e-d139-4f1d-ad5d-f06d46cf8d93 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:26.831469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 663/1318] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:26.836632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e260bbc-43b3-40c0-99d1-daee232fd243 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:26.837076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e260bbc-43b3-40c0-99d1-daee232fd243 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:26.837235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e260bbc-43b3-40c0-99d1-daee232fd243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:26.901624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2e260bbc-43b3-40c0-99d1-daee232fd243 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:26.902846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2e260bbc-43b3-40c0-99d1-daee232fd243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:26.998186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 656/1319] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:27.037448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dec76e-d139-4f1d-ad5d-f06d46cf8d93 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:27.039014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b2dec76e-d139-4f1d-ad5d-f06d46cf8d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:27.141801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dec76e-d139-4f1d-ad5d-f06d46cf8d93 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:27.212210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:27.212869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:27.213151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:27.213421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:27.215030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:27.222963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:27.321301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:27.322732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c48888-666d-43f6-a5ae-d078e38bd405 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:27.340356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 664/1320] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:30.200548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3557-4696-4c2b-b087-8ebadb57f2f3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:30.201149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3557-4696-4c2b-b087-8ebadb57f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:30.201149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3557-4696-4c2b-b087-8ebadb57f2f3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:30.202493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 657/1321] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:30.207684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e345-5055-446f-b8a7-83081fe27a5b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:30.208137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e345-5055-446f-b8a7-83081fe27a5b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:30.208253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e345-5055-446f-b8a7-83081fe27a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:30.272281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a650e345-5055-446f-b8a7-83081fe27a5b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:30.273495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a650e345-5055-446f-b8a7-83081fe27a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:30.331640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:30.369999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 665/1322] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:30.405434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3557-4696-4c2b-b087-8ebadb57f2f3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:30.407051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-60ef3557-4696-4c2b-b087-8ebadb57f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:30.427174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:30.522308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3557-4696-4c2b-b087-8ebadb57f2f3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:30.596492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:30.597177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:30.597457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:30.597729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:30.599374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:30.670729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:30.713390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:30.714832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83577dad-495b-4bd4-9e04-5108529f26db service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:30.734557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 658/1323] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:32.998164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4105d-3548-44ec-965d-8ffd42c010ed None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:32.998673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4105d-3548-44ec-965d-8ffd42c010ed None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:32.998673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4105d-3548-44ec-965d-8ffd42c010ed None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:33.000133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 666/1324] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:33.005865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd995a3d-52b3-4116-9599-4054c2d5fe14 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:33.006268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd995a3d-52b3-4116-9599-4054c2d5fe14 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:33.006430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd995a3d-52b3-4116-9599-4054c2d5fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:33.076555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dd995a3d-52b3-4116-9599-4054c2d5fe14 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:33.077790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dd995a3d-52b3-4116-9599-4054c2d5fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:33.173871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 659/1325] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:33.208973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4105d-3548-44ec-965d-8ffd42c010ed None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:33.210580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a1b4105d-3548-44ec-965d-8ffd42c010ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:33.316744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4105d-3548-44ec-965d-8ffd42c010ed None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:33.390164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:33.390807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:33.391684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:33.391968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:33.393662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:33.410600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:33.507654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:33.509157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ec2f2-f74e-4fba-a2cb-ec6d384987cf service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:33.527447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 667/1326] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:35.849527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f90b5c-5729-43c4-8cbf-cec6c6644ae9 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:35.850055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f90b5c-5729-43c4-8cbf-cec6c6644ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:35.850177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f90b5c-5729-43c4-8cbf-cec6c6644ae9 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:35.851449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 660/1327] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:35.856664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe5e0-8cfc-468a-a356-d50a4c0fc9d0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:35.857108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe5e0-8cfc-468a-a356-d50a4c0fc9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:35.857255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe5e0-8cfc-468a-a356-d50a4c0fc9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:35.923732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-23dbe5e0-8cfc-468a-a356-d50a4c0fc9d0 None None] MFA Rules not processed for user `af2521f6f90246608eabb4e52c5296fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:35.924996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-23dbe5e0-8cfc-468a-a356-d50a4c0fc9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:36.001906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:36.034259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 668/1328] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:00:36.085525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c354a-4976-4bbd-9fe0-9abce42c6a65 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:36.085901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c354a-4976-4bbd-9fe0-9abce42c6a65 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:36.086208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c354a-4976-4bbd-9fe0-9abce42c6a65 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:36.087601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 661/1329] 10.222.0.31 () {54 vars in 964 bytes} [Wed May 25 17:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:36.093536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc17af-3417-4ef0-8421-1c4fdd4613df None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:36.093832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc17af-3417-4ef0-8421-1c4fdd4613df None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:36.094646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc17af-3417-4ef0-8421-1c4fdd4613df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:36.174171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3ddc17af-3417-4ef0-8421-1c4fdd4613df None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:36.175460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3ddc17af-3417-4ef0-8421-1c4fdd4613df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:36.262568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 669/1330] 10.222.0.31 () {58 vars in 1061 bytes} [Wed May 25 17:00:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:36.271613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c354a-4976-4bbd-9fe0-9abce42c6a65 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:36.273380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-356c354a-4976-4bbd-9fe0-9abce42c6a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:36.305490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:36.382285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c354a-4976-4bbd-9fe0-9abce42c6a65 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:36.465853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:36.466627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:36.466974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:36.467313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:36.469176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:36.547655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:36.579554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:36.581042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6bf23-f22c-419f-aa28-1d7c47b1cc3f service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:36.599048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 662/1331] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:39.493205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e09dd-02a1-4641-8e95-6a1e74c0fa0b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:39.493797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e09dd-02a1-4641-8e95-6a1e74c0fa0b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:39.493908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e09dd-02a1-4641-8e95-6a1e74c0fa0b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:39.495330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 670/1332] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:39.501511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abd557-df28-4493-ba34-df38c42e8769 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:39.502002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abd557-df28-4493-ba34-df38c42e8769 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:39.502199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abd557-df28-4493-ba34-df38c42e8769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:39.572000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e2abd557-df28-4493-ba34-df38c42e8769 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:39.573251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e2abd557-df28-4493-ba34-df38c42e8769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:39.673457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 663/1333] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:39.709188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e09dd-02a1-4641-8e95-6a1e74c0fa0b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:39.710852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3a3e09dd-02a1-4641-8e95-6a1e74c0fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:39.786448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:39.821373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e09dd-02a1-4641-8e95-6a1e74c0fa0b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:39.900336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:39.900939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:39.901223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:39.901500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:39.903143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:40.012206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:40.013788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bc517-3569-40fe-b0fc-019fc56b1566 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:40.024567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:40.033297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 671/1334] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:42.318006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280fe6c-7127-40aa-866b-e1daaa3341a7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:42.318564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280fe6c-7127-40aa-866b-e1daaa3341a7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:42.318564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280fe6c-7127-40aa-866b-e1daaa3341a7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:42.319942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 664/1335] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:42.325155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06065-a394-4d69-ba01-2a0d9d5f0ce8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:42.325579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06065-a394-4d69-ba01-2a0d9d5f0ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:42.325719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06065-a394-4d69-ba01-2a0d9d5f0ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:42.390924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-92d06065-a394-4d69-ba01-2a0d9d5f0ce8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:42.392215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-92d06065-a394-4d69-ba01-2a0d9d5f0ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:42.490057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 672/1336] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:00:42.530278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280fe6c-7127-40aa-866b-e1daaa3341a7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:42.532431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1280fe6c-7127-40aa-866b-e1daaa3341a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:42.571758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:42.634513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280fe6c-7127-40aa-866b-e1daaa3341a7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:42.709033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:42.709676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:42.709954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:42.710225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:42.711837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:42.793491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:42.820766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:42.822275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d50dd5-8eea-4bb3-9b76-5ca61bbe848c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:42.842001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 665/1337] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:45.517557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418cd0-f259-43a1-916f-0c2ac85842b3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:45.518096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418cd0-f259-43a1-916f-0c2ac85842b3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:45.518096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418cd0-f259-43a1-916f-0c2ac85842b3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:45.519463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 673/1338] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:45.524629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec078-52c3-4bed-b11b-2be4f52fe0bb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:45.525052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec078-52c3-4bed-b11b-2be4f52fe0bb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:45.525223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec078-52c3-4bed-b11b-2be4f52fe0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:45.590146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0cfec078-52c3-4bed-b11b-2be4f52fe0bb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:45.591373 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0cfec078-52c3-4bed-b11b-2be4f52fe0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:45.686924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 666/1339] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:45.724768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6418cd0-f259-43a1-916f-0c2ac85842b3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:45.726318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6418cd0-f259-43a1-916f-0c2ac85842b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:45.803557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:45.832280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6418cd0-f259-43a1-916f-0c2ac85842b3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:45.907240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:45.907891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:45.908176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:45.908452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:45.910178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:46.020786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:46.022238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9303967-ac56-4fd8-9f63-df3c50b9f945 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:46.040039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 674/1340] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:50.342427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e96c-607c-4fd3-befb-8ac362063d73 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:50.343005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e96c-607c-4fd3-befb-8ac362063d73 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:50.343005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576e96c-607c-4fd3-befb-8ac362063d73 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:50.345303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 667/1341] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:50.350346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e66e1-4578-47c3-9129-855bde264e0c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:50.350759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e66e1-4578-47c3-9129-855bde264e0c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:50.350897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e66e1-4578-47c3-9129-855bde264e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:50.356924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:50.421402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3b1e66e1-4578-47c3-9129-855bde264e0c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:50.423057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3b1e66e1-4578-47c3-9129-855bde264e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:50.527579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 675/1342] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:50.566875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e96c-607c-4fd3-befb-8ac362063d73 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:50.569116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4576e96c-607c-4fd3-befb-8ac362063d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:50.619507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:00:50.666729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576e96c-607c-4fd3-befb-8ac362063d73 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:50.670358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf270e-6321-4ab5-951f-0a0f2234db76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:50.671010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf270e-6321-4ab5-951f-0a0f2234db76 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:50.671301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf270e-6321-4ab5-951f-0a0f2234db76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:50.671636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf270e-6321-4ab5-951f-0a0f2234db76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:50.681734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf270e-6321-4ab5-951f-0a0f2234db76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:50.683498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf270e-6321-4ab5-951f-0a0f2234db76 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:50.693438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 668/1343] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:00:53.659409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e703-95b5-474c-ad16-8d03ad03400c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:53.659935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e703-95b5-474c-ad16-8d03ad03400c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:53.659935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e703-95b5-474c-ad16-8d03ad03400c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:53.661269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 676/1344] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:53.666544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1063625-7ada-40f4-b639-4dc5e358dd69 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:53.666986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1063625-7ada-40f4-b639-4dc5e358dd69 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:53.667133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1063625-7ada-40f4-b639-4dc5e358dd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:53.699258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c1063625-7ada-40f4-b639-4dc5e358dd69 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:53.700920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c1063625-7ada-40f4-b639-4dc5e358dd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:53.777292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 669/1345] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:00:53.814938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6e703-95b5-474c-ad16-8d03ad03400c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:53.816745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e0b6e703-95b5-474c-ad16-8d03ad03400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:53.829584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6e703-95b5-474c-ad16-8d03ad03400c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:53.833009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640239f-e635-4bd6-b8f1-bc6201adaf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:53.833642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640239f-e635-4bd6-b8f1-bc6201adaf9f service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:53.833919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640239f-e635-4bd6-b8f1-bc6201adaf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:53.834193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640239f-e635-4bd6-b8f1-bc6201adaf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:53.843083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640239f-e635-4bd6-b8f1-bc6201adaf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:53.844661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640239f-e635-4bd6-b8f1-bc6201adaf9f service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:53.854400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 677/1346] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:00:57.967779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a882b3-3ef1-422c-952c-d51413d4e08a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:57.968329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a882b3-3ef1-422c-952c-d51413d4e08a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:57.968329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a882b3-3ef1-422c-952c-d51413d4e08a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:57.970769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 670/1347] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:00:57.976302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1919-6429-4648-bd42-7bdb6decda2b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:57.976775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1919-6429-4648-bd42-7bdb6decda2b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:57.976898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1919-6429-4648-bd42-7bdb6decda2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:57.995434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e7cb1919-6429-4648-bd42-7bdb6decda2b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:00:57.996659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7cb1919-6429-4648-bd42-7bdb6decda2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:00:58.004761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 678/1348] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:00:58.042325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a882b3-3ef1-422c-952c-d51413d4e08a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:00:58.054116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a882b3-3ef1-422c-952c-d51413d4e08a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:00:58.057709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca64322-77ab-411e-95a9-5a394a682a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:00:58.058344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca64322-77ab-411e-95a9-5a394a682a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:00:58.058888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca64322-77ab-411e-95a9-5a394a682a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:00:58.059171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca64322-77ab-411e-95a9-5a394a682a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:00:58.069470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca64322-77ab-411e-95a9-5a394a682a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:00:58.071134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca64322-77ab-411e-95a9-5a394a682a94 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:00:58.082707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 671/1349] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:03.596939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b375-09da-4243-8754-fb8acf5e3720 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:03.597452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b375-09da-4243-8754-fb8acf5e3720 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:03.597739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b375-09da-4243-8754-fb8acf5e3720 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:03.599183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 679/1350] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:03.604107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3b4f-c2a9-470d-89d9-1eb064ab51e0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:03.604535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3b4f-c2a9-470d-89d9-1eb064ab51e0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:03.604890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3b4f-c2a9-470d-89d9-1eb064ab51e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:03.682732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5c7a3b4f-c2a9-470d-89d9-1eb064ab51e0 None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:03.684411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5c7a3b4f-c2a9-470d-89d9-1eb064ab51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:03.720617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:03.773725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 672/1351] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:01:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:07.990173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=72 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:08.037435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31ecc4-9fef-45bb-bada-e907ce991995 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:08.037814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31ecc4-9fef-45bb-bada-e907ce991995 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:08.038039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31ecc4-9fef-45bb-bada-e907ce991995 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:08.039532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 680/1352] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:08.044451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ab24-64d8-4d3a-aa04-f98c597ed670 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:08.044983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ab24-64d8-4d3a-aa04-f98c597ed670 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:08.045068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ab24-64d8-4d3a-aa04-f98c597ed670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:08.066205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5d16ab24-64d8-4d3a-aa04-f98c597ed670 None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:08.067424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d16ab24-64d8-4d3a-aa04-f98c597ed670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:08.076189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 673/1353] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:01:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:09.802521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2019-f380-4322-a386-2351e717ea37 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:09.803058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2019-f380-4322-a386-2351e717ea37 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:09.803058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2019-f380-4322-a386-2351e717ea37 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:09.804411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 681/1354] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:09.809708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e49b4b-8950-45a2-8e99-b0135398dfce None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:09.810161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e49b4b-8950-45a2-8e99-b0135398dfce None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:09.810259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e49b4b-8950-45a2-8e99-b0135398dfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:09.829484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-50e49b4b-8950-45a2-8e99-b0135398dfce None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:09.830866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-50e49b4b-8950-45a2-8e99-b0135398dfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:09.839229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 674/1355] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:01:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:13.736239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f814-37cc-4d86-ad7e-23c23e1a5556 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:13.737142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f814-37cc-4d86-ad7e-23c23e1a5556 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:13.737615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f814-37cc-4d86-ad7e-23c23e1a5556 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:13.742211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 682/1356] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:13.744558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85926c51-7b11-4235-a67b-033970636c9a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:13.745352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85926c51-7b11-4235-a67b-033970636c9a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:13.745778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85926c51-7b11-4235-a67b-033970636c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:13.765787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-85926c51-7b11-4235-a67b-033970636c9a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:13.767772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-85926c51-7b11-4235-a67b-033970636c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:13.775777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 675/1357] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:13.832203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06658a-bd9a-4b55-ba54-61e5452bec7b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:13.832902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06658a-bd9a-4b55-ba54-61e5452bec7b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:13.838649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06658a-bd9a-4b55-ba54-61e5452bec7b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:13.841573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 683/1358] 10.222.0.31 () {54 vars in 961 bytes} [Wed May 25 17:01:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:13.864698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7aa3-59b3-4857-b908-25e0ba44ab7b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:13.865449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7aa3-59b3-4857-b908-25e0ba44ab7b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:13.866508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae7aa3-59b3-4857-b908-25e0ba44ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:13.920313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7dae7aa3-59b3-4857-b908-25e0ba44ab7b None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:13.921644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7dae7aa3-59b3-4857-b908-25e0ba44ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:14.010244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 676/1359] 10.222.0.31 () {58 vars in 1058 bytes} [Wed May 25 17:01:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:14.017885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06658a-bd9a-4b55-ba54-61e5452bec7b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:14.032613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06658a-bd9a-4b55-ba54-61e5452bec7b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:14.039932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae078bf-0c63-48ea-9fa6-e97b228986a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:14.040807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae078bf-0c63-48ea-9fa6-e97b228986a2 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:14.041095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae078bf-0c63-48ea-9fa6-e97b228986a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:14.041712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae078bf-0c63-48ea-9fa6-e97b228986a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:14.057004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae078bf-0c63-48ea-9fa6-e97b228986a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:14.058629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae078bf-0c63-48ea-9fa6-e97b228986a2 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:14.070479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 684/1360] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:16.560863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a61e-9a80-493b-b329-21b7032a32de None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:16.561395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a61e-9a80-493b-b329-21b7032a32de None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:16.561480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a61e-9a80-493b-b329-21b7032a32de None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:16.562962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 677/1361] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:16.568617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b613-be23-4e7a-b471-e3a9fddfc11a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:16.569508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b613-be23-4e7a-b471-e3a9fddfc11a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:16.569790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7b613-be23-4e7a-b471-e3a9fddfc11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:16.588139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-04c7b613-be23-4e7a-b471-e3a9fddfc11a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:16.589381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-04c7b613-be23-4e7a-b471-e3a9fddfc11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:16.597468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 685/1362] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:16.642891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a61e-9a80-493b-b329-21b7032a32de None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:16.660498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a61e-9a80-493b-b329-21b7032a32de None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:16.666162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed54d3-6f4a-4a64-922c-095397104266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:16.666842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed54d3-6f4a-4a64-922c-095397104266 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:16.667127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed54d3-6f4a-4a64-922c-095397104266 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:16.667404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed54d3-6f4a-4a64-922c-095397104266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:16.676605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed54d3-6f4a-4a64-922c-095397104266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:16.678268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed54d3-6f4a-4a64-922c-095397104266 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:16.689506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 678/1363] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:19.283370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97afcf-e126-43f0-b25e-a3e2cfdec0cc None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:19.283882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97afcf-e126-43f0-b25e-a3e2cfdec0cc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:19.283999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97afcf-e126-43f0-b25e-a3e2cfdec0cc None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:19.285332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 686/1364] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:19.290764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50938706-d1b7-4602-90de-f656d8b55f23 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:19.291195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50938706-d1b7-4602-90de-f656d8b55f23 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:19.291340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50938706-d1b7-4602-90de-f656d8b55f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:19.310402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-50938706-d1b7-4602-90de-f656d8b55f23 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:19.311610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-50938706-d1b7-4602-90de-f656d8b55f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:19.321270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 679/1365] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:19.368537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c87ee9-ac22-4016-9181-977a0e927c39 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:19.369405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c87ee9-ac22-4016-9181-977a0e927c39 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:19.373814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c87ee9-ac22-4016-9181-977a0e927c39 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:19.375351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 687/1366] 10.222.0.31 () {54 vars in 961 bytes} [Wed May 25 17:01:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:01:19.388566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8c02-7bd7-451a-af3f-2137230e79d6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:19.388876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8c02-7bd7-451a-af3f-2137230e79d6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:19.389158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8c02-7bd7-451a-af3f-2137230e79d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:19.418217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2c1a8c02-7bd7-451a-af3f-2137230e79d6 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:19.419660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2c1a8c02-7bd7-451a-af3f-2137230e79d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:19.433520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 680/1367] 10.222.0.31 () {58 vars in 1058 bytes} [Wed May 25 17:01:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:19.443542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c87ee9-ac22-4016-9181-977a0e927c39 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:19.459388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c87ee9-ac22-4016-9181-977a0e927c39 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:19.464890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dbd16-2ed8-40c7-a9eb-23820e176630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:19.465470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dbd16-2ed8-40c7-a9eb-23820e176630 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:19.465754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dbd16-2ed8-40c7-a9eb-23820e176630 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:19.466178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dbd16-2ed8-40c7-a9eb-23820e176630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:19.475353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dbd16-2ed8-40c7-a9eb-23820e176630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:19.476999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dbd16-2ed8-40c7-a9eb-23820e176630 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:19.486931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 688/1368] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:21.784130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad18c80-b50e-4e9e-9a19-bc56ec464297 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:21.784670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad18c80-b50e-4e9e-9a19-bc56ec464297 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:21.784670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad18c80-b50e-4e9e-9a19-bc56ec464297 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:21.786079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 681/1369] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:21.791573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8002554-d9ec-4546-8bcf-f3d63dad7314 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:21.792009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8002554-d9ec-4546-8bcf-f3d63dad7314 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:21.792140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8002554-d9ec-4546-8bcf-f3d63dad7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:21.811471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e8002554-d9ec-4546-8bcf-f3d63dad7314 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:21.812939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e8002554-d9ec-4546-8bcf-f3d63dad7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:21.821203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 689/1370] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:21.865533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad18c80-b50e-4e9e-9a19-bc56ec464297 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:21.880422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad18c80-b50e-4e9e-9a19-bc56ec464297 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:21.886127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8541a73-033a-4e05-a137-c1507d37084f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:21.886879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541a73-033a-4e05-a137-c1507d37084f service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:21.887266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541a73-033a-4e05-a137-c1507d37084f service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:21.887642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8541a73-033a-4e05-a137-c1507d37084f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:21.900402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8541a73-033a-4e05-a137-c1507d37084f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:21.902197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8541a73-033a-4e05-a137-c1507d37084f service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:21.913211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 682/1371] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:22.128254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186da7-fd88-467b-b334-d778676c8ff1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:22.128544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186da7-fd88-467b-b334-d778676c8ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:22.128864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186da7-fd88-467b-b334-d778676c8ff1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:22.130240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 690/1372] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:22.136228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829422c-cd21-4c85-821a-f1a91e673a30 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:22.136514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829422c-cd21-4c85-821a-f1a91e673a30 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:22.136833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829422c-cd21-4c85-821a-f1a91e673a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:22.155961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0829422c-cd21-4c85-821a-f1a91e673a30 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:22.157606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0829422c-cd21-4c85-821a-f1a91e673a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:22.171325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 683/1373] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:22.509487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086ecfa-6962-4efa-9b65-3415fce0efbb None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:22.509948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086ecfa-6962-4efa-9b65-3415fce0efbb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:22.510418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086ecfa-6962-4efa-9b65-3415fce0efbb None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:22.513052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 691/1374] 10.222.0.31 () {54 vars in 963 bytes} [Wed May 25 17:01:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:22.519861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47b9a-c10c-4c5a-98a6-d254ef8a0679 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:22.520286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47b9a-c10c-4c5a-98a6-d254ef8a0679 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:22.520698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47b9a-c10c-4c5a-98a6-d254ef8a0679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:22.528333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:22.573458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d3f47b9a-c10c-4c5a-98a6-d254ef8a0679 None None] MFA Rules not processed for user `ca966a266e17460b8e38790f506eb406`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:22.574930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d3f47b9a-c10c-4c5a-98a6-d254ef8a0679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:22.638813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 684/1375] 10.222.0.31 () {58 vars in 1060 bytes} [Wed May 25 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:01:22.646945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086ecfa-6962-4efa-9b65-3415fce0efbb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:22.658970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086ecfa-6962-4efa-9b65-3415fce0efbb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:22.662783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0276611-6249-4230-8a1f-04cdfe73b66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:22.663486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276611-6249-4230-8a1f-04cdfe73b66b service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:22.663777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276611-6249-4230-8a1f-04cdfe73b66b service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:22.664055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276611-6249-4230-8a1f-04cdfe73b66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:22.677223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0276611-6249-4230-8a1f-04cdfe73b66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:22.678933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0276611-6249-4230-8a1f-04cdfe73b66b service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:22.693243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 692/1376] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:24.201566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6727262-b56d-4bcf-8c0a-1a1fc341530f None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:24.202154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6727262-b56d-4bcf-8c0a-1a1fc341530f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:24.202154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6727262-b56d-4bcf-8c0a-1a1fc341530f None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:24.203522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 685/1377] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:24.210230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93ef84-c6f2-4e5a-98c5-836079aaed51 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:24.210814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93ef84-c6f2-4e5a-98c5-836079aaed51 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:24.210814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93ef84-c6f2-4e5a-98c5-836079aaed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:24.234093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-aa93ef84-c6f2-4e5a-98c5-836079aaed51 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:24.235028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aa93ef84-c6f2-4e5a-98c5-836079aaed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:24.244856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 693/1378] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:24.296820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6727262-b56d-4bcf-8c0a-1a1fc341530f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:24.313109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6727262-b56d-4bcf-8c0a-1a1fc341530f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:24.319533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4a3f7-aa10-4dbb-b43f-2970724d8258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:24.320193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a3f7-aa10-4dbb-b43f-2970724d8258 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:24.320478 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a3f7-aa10-4dbb-b43f-2970724d8258 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:24.320785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4a3f7-aa10-4dbb-b43f-2970724d8258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:24.330763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4a3f7-aa10-4dbb-b43f-2970724d8258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:24.335257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4a3f7-aa10-4dbb-b43f-2970724d8258 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:24.348316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 686/1379] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:26.658067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27f1a-b544-46c5-98a3-7631e40ba3f9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:26.658572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27f1a-b544-46c5-98a3-7631e40ba3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:26.658811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27f1a-b544-46c5-98a3-7631e40ba3f9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:26.660384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 694/1380] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:26.665973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c800b2-d69e-4692-996c-386dbf4ff888 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:26.666405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c800b2-d69e-4692-996c-386dbf4ff888 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:26.666730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c800b2-d69e-4692-996c-386dbf4ff888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:26.688403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e4c800b2-d69e-4692-996c-386dbf4ff888 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:26.690404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e4c800b2-d69e-4692-996c-386dbf4ff888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:26.698703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 687/1381] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:26.742448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27f1a-b544-46c5-98a3-7631e40ba3f9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:26.759134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27f1a-b544-46c5-98a3-7631e40ba3f9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:26.765278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa999d-83b4-4eb7-9792-916aab6a423d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:26.766100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa999d-83b4-4eb7-9792-916aab6a423d service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:26.766428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa999d-83b4-4eb7-9792-916aab6a423d service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:26.766767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa999d-83b4-4eb7-9792-916aab6a423d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:26.775466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa999d-83b4-4eb7-9792-916aab6a423d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:26.777318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa999d-83b4-4eb7-9792-916aab6a423d service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:26.787504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 695/1382] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:29.050473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f09f-ad44-44f8-927a-3067ead8c237 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:29.051024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f09f-ad44-44f8-927a-3067ead8c237 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:29.051024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f09f-ad44-44f8-927a-3067ead8c237 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:29.052361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 688/1383] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:29.057791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9ea8-9547-4ddd-b0db-c050b294855d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:29.058218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9ea8-9547-4ddd-b0db-c050b294855d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:29.058340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9ea8-9547-4ddd-b0db-c050b294855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:29.076867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-364d9ea8-9547-4ddd-b0db-c050b294855d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:29.077967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-364d9ea8-9547-4ddd-b0db-c050b294855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:29.086625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 696/1384] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:29.127428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f09f-ad44-44f8-927a-3067ead8c237 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:29.142144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f09f-ad44-44f8-927a-3067ead8c237 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:29.147690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee8ff9-5d17-4596-b660-0dd2e5d3b966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:29.148332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8ff9-5d17-4596-b660-0dd2e5d3b966 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:29.148615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8ff9-5d17-4596-b660-0dd2e5d3b966 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:29.148916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8ff9-5d17-4596-b660-0dd2e5d3b966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:29.158246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee8ff9-5d17-4596-b660-0dd2e5d3b966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:29.159812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee8ff9-5d17-4596-b660-0dd2e5d3b966 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:29.169721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 689/1385] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:01:31.475383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853752f-80d6-4bed-b4c8-32160139e0ac None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:31.476165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853752f-80d6-4bed-b4c8-32160139e0ac None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:31.476165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853752f-80d6-4bed-b4c8-32160139e0ac None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:31.477415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 697/1386] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:31.482895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93b4b1-4cd6-493f-90fd-ee0c4e393d48 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:31.483419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93b4b1-4cd6-493f-90fd-ee0c4e393d48 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:31.483419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93b4b1-4cd6-493f-90fd-ee0c4e393d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:31.501780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ba93b4b1-4cd6-493f-90fd-ee0c4e393d48 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:31.503088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ba93b4b1-4cd6-493f-90fd-ee0c4e393d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:31.510956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 690/1387] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:31.556350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853752f-80d6-4bed-b4c8-32160139e0ac None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:31.572463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853752f-80d6-4bed-b4c8-32160139e0ac None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:31.578430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad64b-0f6d-4098-92d5-2a20ba46f04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:31.580094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad64b-0f6d-4098-92d5-2a20ba46f04d service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:31.580459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad64b-0f6d-4098-92d5-2a20ba46f04d service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:31.580840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad64b-0f6d-4098-92d5-2a20ba46f04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:31.592117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ad64b-0f6d-4098-92d5-2a20ba46f04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:31.594181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ad64b-0f6d-4098-92d5-2a20ba46f04d service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:31.607820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 698/1388] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:34.291456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09703cd-5779-4fdc-8b56-786f97e482e6 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:34.291995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09703cd-5779-4fdc-8b56-786f97e482e6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:34.291995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09703cd-5779-4fdc-8b56-786f97e482e6 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:34.293458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 691/1389] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:34.300984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84515cf7-73a3-4368-965c-27f269bdf539 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:34.301431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84515cf7-73a3-4368-965c-27f269bdf539 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:34.301535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84515cf7-73a3-4368-965c-27f269bdf539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:34.321135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-84515cf7-73a3-4368-965c-27f269bdf539 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:34.322421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-84515cf7-73a3-4368-965c-27f269bdf539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:34.330628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 699/1390] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:34.374287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09703cd-5779-4fdc-8b56-786f97e482e6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:34.397943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09703cd-5779-4fdc-8b56-786f97e482e6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:34.404555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9899278-05df-4549-a95e-26894e9fdf27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:34.405392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9899278-05df-4549-a95e-26894e9fdf27 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:34.405729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9899278-05df-4549-a95e-26894e9fdf27 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:34.406126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9899278-05df-4549-a95e-26894e9fdf27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:34.416894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9899278-05df-4549-a95e-26894e9fdf27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:34.419283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9899278-05df-4549-a95e-26894e9fdf27 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:34.432593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 692/1391] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:37.097866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc7bb-1f7e-4aa8-ba57-9f89da2454e6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:37.098469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc7bb-1f7e-4aa8-ba57-9f89da2454e6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:37.098589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc7bb-1f7e-4aa8-ba57-9f89da2454e6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:37.099859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 700/1392] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:37.105145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347700fe-3934-4df3-8ef4-2cbe6192ae3f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:37.105579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347700fe-3934-4df3-8ef4-2cbe6192ae3f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:37.105844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347700fe-3934-4df3-8ef4-2cbe6192ae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:37.127492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-347700fe-3934-4df3-8ef4-2cbe6192ae3f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:37.128713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-347700fe-3934-4df3-8ef4-2cbe6192ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:37.136490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 693/1393] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:37.181176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc7bb-1f7e-4aa8-ba57-9f89da2454e6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:37.196468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc7bb-1f7e-4aa8-ba57-9f89da2454e6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:37.201941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428b69-3581-46ed-aaef-3024a407cfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:37.202579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428b69-3581-46ed-aaef-3024a407cfc1 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:37.202862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428b69-3581-46ed-aaef-3024a407cfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:37.203138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428b69-3581-46ed-aaef-3024a407cfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:37.212067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428b69-3581-46ed-aaef-3024a407cfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:37.213672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428b69-3581-46ed-aaef-3024a407cfc1 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:37.224212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 701/1394] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:38.666145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d5243-5992-436e-8839-c2f9b2e26cd5 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:38.666718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d5243-5992-436e-8839-c2f9b2e26cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:38.666718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d5243-5992-436e-8839-c2f9b2e26cd5 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:38.668067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 694/1395] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:01:38.674021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f53864-ef2d-4a64-a52a-0ee03a22024b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:38.674457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f53864-ef2d-4a64-a52a-0ee03a22024b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:38.674609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f53864-ef2d-4a64-a52a-0ee03a22024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:38.681765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=52 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:38.695542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-69f53864-ef2d-4a64-a52a-0ee03a22024b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:38.696776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-69f53864-ef2d-4a64-a52a-0ee03a22024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:38.704697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 702/1396] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:38.760354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c612e-c5d1-4965-abd5-c187376e6d37 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:38.760768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c612e-c5d1-4965-abd5-c187376e6d37 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:38.761111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c612e-c5d1-4965-abd5-c187376e6d37 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:38.762543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 695/1397] 10.222.0.31 () {54 vars in 962 bytes} [Wed May 25 17:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:38.768230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6aa5f-40f1-4593-86c6-22fdc4a763a9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:38.768523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6aa5f-40f1-4593-86c6-22fdc4a763a9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:38.768827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6aa5f-40f1-4593-86c6-22fdc4a763a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:38.819723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-08a6aa5f-40f1-4593-86c6-22fdc4a763a9 None None] MFA Rules not processed for user `e29e245b61634d66bcca79fe530c6019`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:38.820956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-08a6aa5f-40f1-4593-86c6-22fdc4a763a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:38.881795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 703/1398] 10.222.0.31 () {58 vars in 1059 bytes} [Wed May 25 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:01:38.889793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c612e-c5d1-4965-abd5-c187376e6d37 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:38.901302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c612e-c5d1-4965-abd5-c187376e6d37 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:38.909428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b0966-0319-4949-a614-8c0725d44adc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:38.910078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0966-0319-4949-a614-8c0725d44adc service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:38.910364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0966-0319-4949-a614-8c0725d44adc service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:38.910642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0966-0319-4949-a614-8c0725d44adc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:38.920043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0966-0319-4949-a614-8c0725d44adc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:38.921483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0966-0319-4949-a614-8c0725d44adc service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:38.930947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 696/1399] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:39.474418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b58e-8d6a-4e16-9377-0bec2b28b04e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.474918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b58e-8d6a-4e16-9377-0bec2b28b04e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.475270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b58e-8d6a-4e16-9377-0bec2b28b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.508448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eafa3-aed9-4fbd-b642-dc56627685ed None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.508763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eafa3-aed9-4fbd-b642-dc56627685ed None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.509046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eafa3-aed9-4fbd-b642-dc56627685ed None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.510448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 697/1400] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:01:39.515387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c08b9-a283-4119-9140-84447141a942 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.515676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c08b9-a283-4119-9140-84447141a942 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.515951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c08b9-a283-4119-9140-84447141a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.528173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9ce2b58e-8d6a-4e16-9377-0bec2b28b04e None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:39.529428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9ce2b58e-8d6a-4e16-9377-0bec2b28b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:39.534848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c94c08b9-a283-4119-9140-84447141a942 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:39.536016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c94c08b9-a283-4119-9140-84447141a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:39.543906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 698/1401] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:01:39.589576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c08b9-a283-4119-9140-84447141a942 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:39.594337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 704/1402] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:01:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:39.602432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c08b9-a283-4119-9140-84447141a942 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:39.608086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0c267-6ec9-4d37-83b1-b43240250429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:39.608775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0c267-6ec9-4d37-83b1-b43240250429 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.609064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0c267-6ec9-4d37-83b1-b43240250429 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.609372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0c267-6ec9-4d37-83b1-b43240250429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.619222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0c267-6ec9-4d37-83b1-b43240250429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:39.621057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0c267-6ec9-4d37-83b1-b43240250429 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:39.632005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 699/1403] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:01:39.636270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd54e5-7d54-495a-9e26-fd98d881a62f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.636568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd54e5-7d54-495a-9e26-fd98d881a62f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.636888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd54e5-7d54-495a-9e26-fd98d881a62f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.638244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 705/1404] 10.222.0.31 () {54 vars in 942 bytes} [Wed May 25 17:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:39.645203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabf8f-198c-4e9f-9a87-fbb4234508a4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.645496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabf8f-198c-4e9f-9a87-fbb4234508a4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.645779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dabf8f-198c-4e9f-9a87-fbb4234508a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.710004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e2dabf8f-198c-4e9f-9a87-fbb4234508a4 None None] MFA Rules not processed for user `a7d82cb54434427d816780c435562667`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:39.712032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e2dabf8f-198c-4e9f-9a87-fbb4234508a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:39.734052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:39.794980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 700/1405] 10.222.0.31 () {58 vars in 1039 bytes} [Wed May 25 17:01:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:39.805600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd54e5-7d54-495a-9e26-fd98d881a62f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:39.821375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd54e5-7d54-495a-9e26-fd98d881a62f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:39.826529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e630e1-ed34-4b87-9d31-047484621748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:39.827197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e630e1-ed34-4b87-9d31-047484621748 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:39.827484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e630e1-ed34-4b87-9d31-047484621748 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:39.827765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e630e1-ed34-4b87-9d31-047484621748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:39.838041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e630e1-ed34-4b87-9d31-047484621748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:39.839671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e630e1-ed34-4b87-9d31-047484621748 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:39.849665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 706/1406] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:01:41.982361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140261dd-4604-4ef9-859a-f69a3fa36f53 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:41.982875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140261dd-4604-4ef9-859a-f69a3fa36f53 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:41.982875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140261dd-4604-4ef9-859a-f69a3fa36f53 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:41.984349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 701/1407] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:01:41.990202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e9ed8-cdb0-4e77-876f-0679e89ccc3d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:41.990645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e9ed8-cdb0-4e77-876f-0679e89ccc3d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:41.990760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e9ed8-cdb0-4e77-876f-0679e89ccc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:42.010173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4a2e9ed8-cdb0-4e77-876f-0679e89ccc3d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:01:42.011384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4a2e9ed8-cdb0-4e77-876f-0679e89ccc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:01:42.019967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 707/1408] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:01:42.067678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140261dd-4604-4ef9-859a-f69a3fa36f53 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:01:42.083706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140261dd-4604-4ef9-859a-f69a3fa36f53 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:01:42.089946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7701-1265-4e9e-8501-c4c539578cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:01:42.090595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7701-1265-4e9e-8501-c4c539578cd6 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:01:42.090911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7701-1265-4e9e-8501-c4c539578cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:01:42.091191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7701-1265-4e9e-8501-c4c539578cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:01:42.100261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a7701-1265-4e9e-8501-c4c539578cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:01:42.101909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a7701-1265-4e9e-8501-c4c539578cd6 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:01:42.112280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 702/1409] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:01:52.004916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:01:52.593084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=28 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:02:03.193937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914025-3338-49ee-bfc7-bb24681e5ca6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:03.194590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914025-3338-49ee-bfc7-bb24681e5ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:03.194590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914025-3338-49ee-bfc7-bb24681e5ca6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:03.195892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 708/1410] 10.222.0.31 () {54 vars in 918 bytes} [Wed May 25 17:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:03.200992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be798df-c1e6-4fa4-8df8-5bbc16fc8fb3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:03.201445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be798df-c1e6-4fa4-8df8-5bbc16fc8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:03.201553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be798df-c1e6-4fa4-8df8-5bbc16fc8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:03.219715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1be798df-c1e6-4fa4-8df8-5bbc16fc8fb3 None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:03.220941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1be798df-c1e6-4fa4-8df8-5bbc16fc8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:03.229145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 703/1411] 10.222.0.31 () {58 vars in 1015 bytes} [Wed May 25 17:02:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:03.243137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81d4f6-ad03-412c-b86e-d0510684c087 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:03.243432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81d4f6-ad03-412c-b86e-d0510684c087 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:03.243713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81d4f6-ad03-412c-b86e-d0510684c087 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:03.245157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 709/1412] 10.222.0.31 () {54 vars in 918 bytes} [Wed May 25 17:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:03.249576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77458b2-cd62-4554-bd69-48b40939d6fe None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:03.249893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77458b2-cd62-4554-bd69-48b40939d6fe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:03.250175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77458b2-cd62-4554-bd69-48b40939d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:03.268331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c77458b2-cd62-4554-bd69-48b40939d6fe None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:03.270231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c77458b2-cd62-4554-bd69-48b40939d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:03.281755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 704/1413] 10.222.0.31 () {58 vars in 1015 bytes} [Wed May 25 17:02:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:05.953016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ccf66-0bfc-41e0-9adf-338c9d2b091d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:05.953550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ccf66-0bfc-41e0-9adf-338c9d2b091d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:05.953550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ccf66-0bfc-41e0-9adf-338c9d2b091d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:05.954843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:05.960370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3448d-74d5-4142-8be2-c96a265c25d0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:05.960841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3448d-74d5-4142-8be2-c96a265c25d0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:05.960951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3448d-74d5-4142-8be2-c96a265c25d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:05.978895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-99e3448d-74d5-4142-8be2-c96a265c25d0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:05.980084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-99e3448d-74d5-4142-8be2-c96a265c25d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:05.988449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:06.030944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ccf66-0bfc-41e0-9adf-338c9d2b091d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:06.045848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ccf66-0bfc-41e0-9adf-338c9d2b091d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:06.053037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7565c-f12b-488c-a54f-c5abd296ec8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:06.053698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7565c-f12b-488c-a54f-c5abd296ec8e service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:06.053999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7565c-f12b-488c-a54f-c5abd296ec8e service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:06.054271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7565c-f12b-488c-a54f-c5abd296ec8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:06.062749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7565c-f12b-488c-a54f-c5abd296ec8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:06.064357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7565c-f12b-488c-a54f-c5abd296ec8e service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:06.073678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 711/1416] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:07.041874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb8cb-47c1-4050-8db1-28aabc0f9301 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:07.042404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb8cb-47c1-4050-8db1-28aabc0f9301 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:07.042404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb8cb-47c1-4050-8db1-28aabc0f9301 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:07.043715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:07.048585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec5c1-15f6-4a24-be78-3d74ea0d56b8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:07.049041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec5c1-15f6-4a24-be78-3d74ea0d56b8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:07.049161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec5c1-15f6-4a24-be78-3d74ea0d56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:07.068307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ff2ec5c1-15f6-4a24-be78-3d74ea0d56b8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:07.069529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ff2ec5c1-15f6-4a24-be78-3d74ea0d56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:07.077399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:07.235158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb8cb-47c1-4050-8db1-28aabc0f9301 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:07.250220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb8cb-47c1-4050-8db1-28aabc0f9301 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:07.256235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff6277-2eab-4bff-9c8a-e88da2c42497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:07.256902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff6277-2eab-4bff-9c8a-e88da2c42497 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:07.257196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff6277-2eab-4bff-9c8a-e88da2c42497 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:07.257479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff6277-2eab-4bff-9c8a-e88da2c42497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:07.265637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff6277-2eab-4bff-9c8a-e88da2c42497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:07.267277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff6277-2eab-4bff-9c8a-e88da2c42497 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:07.276793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 707/1419] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:08.204402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040b17-88df-49e6-9735-e083e58db585 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:08.205012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040b17-88df-49e6-9735-e083e58db585 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:08.205012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040b17-88df-49e6-9735-e083e58db585 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:08.206355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:08.211304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d44e0-b907-458f-9d3c-7ddc7df819cb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:08.211708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d44e0-b907-458f-9d3c-7ddc7df819cb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:08.211866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d44e0-b907-458f-9d3c-7ddc7df819cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:08.230130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-255d44e0-b907-458f-9d3c-7ddc7df819cb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:08.231330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-255d44e0-b907-458f-9d3c-7ddc7df819cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:08.239845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:08.389527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040b17-88df-49e6-9735-e083e58db585 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:08.403812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040b17-88df-49e6-9735-e083e58db585 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:08.409681 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47501-2226-4295-a035-3ac307c386e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:08.410312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47501-2226-4295-a035-3ac307c386e1 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:08.410593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47501-2226-4295-a035-3ac307c386e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:08.410867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47501-2226-4295-a035-3ac307c386e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:08.418848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47501-2226-4295-a035-3ac307c386e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:08.420426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47501-2226-4295-a035-3ac307c386e1 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:08.430477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 714/1422] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:09.343233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5515c-ce88-46c6-b19b-e86d1dd624d5 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:09.343780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5515c-ce88-46c6-b19b-e86d1dd624d5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:09.343780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5515c-ce88-46c6-b19b-e86d1dd624d5 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:09.345202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:09.350497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f371348-e548-4732-9434-d1f9ebcf1475 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:09.351229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f371348-e548-4732-9434-d1f9ebcf1475 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:09.351474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f371348-e548-4732-9434-d1f9ebcf1475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:09.370502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8f371348-e548-4732-9434-d1f9ebcf1475 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:09.371727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8f371348-e548-4732-9434-d1f9ebcf1475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:09.380139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:02:09.527791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5515c-ce88-46c6-b19b-e86d1dd624d5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:09.542150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5515c-ce88-46c6-b19b-e86d1dd624d5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:09.547587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548a3dd-019b-4ea1-9c3f-6a84d248bb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:09.548218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a3dd-019b-4ea1-9c3f-6a84d248bb71 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:09.548502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a3dd-019b-4ea1-9c3f-6a84d248bb71 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:09.548815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a3dd-019b-4ea1-9c3f-6a84d248bb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:09.557483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548a3dd-019b-4ea1-9c3f-6a84d248bb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:09.559078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548a3dd-019b-4ea1-9c3f-6a84d248bb71 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:09.569648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 710/1425] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:10.476904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1f159-bd13-429d-956e-b9d7d0221940 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:10.477451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1f159-bd13-429d-956e-b9d7d0221940 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:10.477451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1f159-bd13-429d-956e-b9d7d0221940 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:10.478863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:10.483953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b44f-fb44-4112-b21c-60e07b2cc9b1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:10.484369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b44f-fb44-4112-b21c-60e07b2cc9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:10.484510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b44f-fb44-4112-b21c-60e07b2cc9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:10.502813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8ab3b44f-fb44-4112-b21c-60e07b2cc9b1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:10.504169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8ab3b44f-fb44-4112-b21c-60e07b2cc9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:10.512063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:10.665751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1f159-bd13-429d-956e-b9d7d0221940 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:10.681306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1f159-bd13-429d-956e-b9d7d0221940 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:10.686978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda2253-0275-4c41-8e4d-2e96f5a8dca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:10.687625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda2253-0275-4c41-8e4d-2e96f5a8dca2 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:10.687908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda2253-0275-4c41-8e4d-2e96f5a8dca2 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:10.688187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda2253-0275-4c41-8e4d-2e96f5a8dca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:10.696835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda2253-0275-4c41-8e4d-2e96f5a8dca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:10.698429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda2253-0275-4c41-8e4d-2e96f5a8dca2 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:10.708196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 717/1428] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:02:11.614887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7bba1-839b-450a-a67f-c88c4a07d5e7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:11.615516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7bba1-839b-450a-a67f-c88c4a07d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:11.615516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7bba1-839b-450a-a67f-c88c4a07d5e7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:11.616896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:02:11.622296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256cb0a-9bd4-4a29-b551-e071292774eb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:11.622711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256cb0a-9bd4-4a29-b551-e071292774eb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:11.622851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256cb0a-9bd4-4a29-b551-e071292774eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:11.641501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e256cb0a-9bd4-4a29-b551-e071292774eb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:11.642684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e256cb0a-9bd4-4a29-b551-e071292774eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:11.650658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:11.798312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7bba1-839b-450a-a67f-c88c4a07d5e7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:11.813369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7bba1-839b-450a-a67f-c88c4a07d5e7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:11.819572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e23e-17a6-4455-926f-34dfbf4aad0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:11.820214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e23e-17a6-4455-926f-34dfbf4aad0d service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:11.820498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e23e-17a6-4455-926f-34dfbf4aad0d service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:11.820808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e23e-17a6-4455-926f-34dfbf4aad0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:11.829050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542e23e-17a6-4455-926f-34dfbf4aad0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:11.830633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542e23e-17a6-4455-926f-34dfbf4aad0d service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:11.839927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 713/1431] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:12.695143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd104b7-82bd-4ca9-a304-345bc54810a4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:12.695628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd104b7-82bd-4ca9-a304-345bc54810a4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:12.695727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd104b7-82bd-4ca9-a304-345bc54810a4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:12.697112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:12.701992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b12b-3cc1-444a-aedb-8a6e0f5f5874 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:12.702408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b12b-3cc1-444a-aedb-8a6e0f5f5874 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:12.702553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b12b-3cc1-444a-aedb-8a6e0f5f5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:12.721343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7548b12b-3cc1-444a-aedb-8a6e0f5f5874 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:12.723099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7548b12b-3cc1-444a-aedb-8a6e0f5f5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:12.730914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:12.878774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd104b7-82bd-4ca9-a304-345bc54810a4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:12.903798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd104b7-82bd-4ca9-a304-345bc54810a4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:12.909927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e584dc4-70a3-4f2c-89e0-b723155fe91b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:12.910649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584dc4-70a3-4f2c-89e0-b723155fe91b service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:12.910932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584dc4-70a3-4f2c-89e0-b723155fe91b service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:12.911208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584dc4-70a3-4f2c-89e0-b723155fe91b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:12.919725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e584dc4-70a3-4f2c-89e0-b723155fe91b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:12.921359 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e584dc4-70a3-4f2c-89e0-b723155fe91b service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:12.931629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 720/1434] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:13.787729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb1846-4513-4783-8d1e-3cac57cdb3cd None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:13.788265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb1846-4513-4783-8d1e-3cac57cdb3cd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:13.788265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb1846-4513-4783-8d1e-3cac57cdb3cd None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:13.789683 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:13.794627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36014701-1e46-4ada-8a89-845870ba3457 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:13.795073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36014701-1e46-4ada-8a89-845870ba3457 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:13.795181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36014701-1e46-4ada-8a89-845870ba3457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:13.814016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-36014701-1e46-4ada-8a89-845870ba3457 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:13.815223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-36014701-1e46-4ada-8a89-845870ba3457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:13.823765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:02:13.973641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb1846-4513-4783-8d1e-3cac57cdb3cd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:13.989238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb1846-4513-4783-8d1e-3cac57cdb3cd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:13.994690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea61e-a60b-4624-9d89-624883d2bc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:13.995333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea61e-a60b-4624-9d89-624883d2bc93 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:13.995620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea61e-a60b-4624-9d89-624883d2bc93 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:13.995898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea61e-a60b-4624-9d89-624883d2bc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:14.004666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ea61e-a60b-4624-9d89-624883d2bc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:14.006325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ea61e-a60b-4624-9d89-624883d2bc93 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:14.015985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 716/1437] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:14.869803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ebbc-6eb5-455a-8f20-b2a388491ef6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:14.870354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ebbc-6eb5-455a-8f20-b2a388491ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:14.870354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ebbc-6eb5-455a-8f20-b2a388491ef6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:14.871722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:02:14.876659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3218c-9e0b-4924-82bb-b0f97111600a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:14.877125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3218c-9e0b-4924-82bb-b0f97111600a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:14.877273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3218c-9e0b-4924-82bb-b0f97111600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:14.896845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-acd3218c-9e0b-4924-82bb-b0f97111600a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:14.898348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-acd3218c-9e0b-4924-82bb-b0f97111600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:14.907104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:15.063808 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ebbc-6eb5-455a-8f20-b2a388491ef6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:15.078604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ebbc-6eb5-455a-8f20-b2a388491ef6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:15.086155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42271aab-0123-4f35-bf34-67fd9c38576b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:15.086792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42271aab-0123-4f35-bf34-67fd9c38576b service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:15.087076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42271aab-0123-4f35-bf34-67fd9c38576b service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:15.087353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42271aab-0123-4f35-bf34-67fd9c38576b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:15.095729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42271aab-0123-4f35-bf34-67fd9c38576b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:15.097372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42271aab-0123-4f35-bf34-67fd9c38576b service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:15.106884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 723/1440] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:17.244996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957dec-d0e6-4feb-9314-c6c93a5d063c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:17.245529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957dec-d0e6-4feb-9314-c6c93a5d063c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:17.245529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957dec-d0e6-4feb-9314-c6c93a5d063c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:17.246892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:17.252142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47e52-c5a9-48c1-baa6-353bb87db6a1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:17.252540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47e52-c5a9-48c1-baa6-353bb87db6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:17.253279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47e52-c5a9-48c1-baa6-353bb87db6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:17.271743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3bf47e52-c5a9-48c1-baa6-353bb87db6a1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:17.272974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3bf47e52-c5a9-48c1-baa6-353bb87db6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:17.280900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:17.319388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb957dec-d0e6-4feb-9314-c6c93a5d063c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:17.330189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb957dec-d0e6-4feb-9314-c6c93a5d063c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:17.334486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2739b-33d5-4759-bdb5-4a9b7bf1bbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:17.335114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2739b-33d5-4759-bdb5-4a9b7bf1bbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:17.335395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2739b-33d5-4759-bdb5-4a9b7bf1bbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:17.335670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2739b-33d5-4759-bdb5-4a9b7bf1bbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:17.344452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2739b-33d5-4759-bdb5-4a9b7bf1bbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:17.345921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2739b-33d5-4759-bdb5-4a9b7bf1bbf6 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:17.355749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 719/1443] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:19.752176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bfd07-b4f4-42b6-b830-50031d7139d4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:19.752729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bfd07-b4f4-42b6-b830-50031d7139d4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:19.752873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bfd07-b4f4-42b6-b830-50031d7139d4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:19.754139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:19.759665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75115d5-153d-47ee-a359-66327415d967 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:19.760103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75115d5-153d-47ee-a359-66327415d967 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:19.760214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75115d5-153d-47ee-a359-66327415d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:19.778477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e75115d5-153d-47ee-a359-66327415d967 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:19.779695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e75115d5-153d-47ee-a359-66327415d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:19.788399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:19.826247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bfd07-b4f4-42b6-b830-50031d7139d4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:19.837399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bfd07-b4f4-42b6-b830-50031d7139d4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:19.840976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aa175-0c85-4ea5-b50a-f54a5269b7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:19.841604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aa175-0c85-4ea5-b50a-f54a5269b7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:19.841886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aa175-0c85-4ea5-b50a-f54a5269b7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:19.842158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aa175-0c85-4ea5-b50a-f54a5269b7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:19.851665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63aa175-0c85-4ea5-b50a-f54a5269b7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:19.853130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63aa175-0c85-4ea5-b50a-f54a5269b7d7 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:19.862283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 726/1446] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:22.544366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ffed4-f53c-4d59-9fed-addef31041a0 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:22.544955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ffed4-f53c-4d59-9fed-addef31041a0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:22.544955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ffed4-f53c-4d59-9fed-addef31041a0 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:22.546369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:22.552589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af9ea1-8d76-49ea-b727-6518add6c282 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:22.553094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af9ea1-8d76-49ea-b727-6518add6c282 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:22.553410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af9ea1-8d76-49ea-b727-6518add6c282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:22.572617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b1af9ea1-8d76-49ea-b727-6518add6c282 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:22.573857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b1af9ea1-8d76-49ea-b727-6518add6c282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:22.582274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:22.620649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ffed4-f53c-4d59-9fed-addef31041a0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:22.631311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ffed4-f53c-4d59-9fed-addef31041a0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:22.634809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348cad-80a7-4e20-9553-137fe771ea0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:22.635440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348cad-80a7-4e20-9553-137fe771ea0e service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:22.635714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348cad-80a7-4e20-9553-137fe771ea0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:22.635987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348cad-80a7-4e20-9553-137fe771ea0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:22.644820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348cad-80a7-4e20-9553-137fe771ea0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:22.646285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348cad-80a7-4e20-9553-137fe771ea0e service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:22.655421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 722/1449] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:25.008342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310a49-51ce-4a86-966e-6dabbfdf0c02 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:25.009249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310a49-51ce-4a86-966e-6dabbfdf0c02 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:25.009249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310a49-51ce-4a86-966e-6dabbfdf0c02 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:25.010290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:25.016793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b0513-f923-40c6-ab04-f63f8a3d53a9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:25.017216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b0513-f923-40c6-ab04-f63f8a3d53a9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:25.017345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b0513-f923-40c6-ab04-f63f8a3d53a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:25.035793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8a1b0513-f923-40c6-ab04-f63f8a3d53a9 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:25.037019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a1b0513-f923-40c6-ab04-f63f8a3d53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:25.044657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:25.083271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310a49-51ce-4a86-966e-6dabbfdf0c02 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:25.094038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310a49-51ce-4a86-966e-6dabbfdf0c02 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:25.097613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ff140-493f-4b1f-b53d-2ff2028b2aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:25.098246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ff140-493f-4b1f-b53d-2ff2028b2aec service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:25.098533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ff140-493f-4b1f-b53d-2ff2028b2aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:25.098813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ff140-493f-4b1f-b53d-2ff2028b2aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:25.107680 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ff140-493f-4b1f-b53d-2ff2028b2aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:25.109158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ff140-493f-4b1f-b53d-2ff2028b2aec service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:25.118917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 729/1452] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:27.396350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc834-cdf1-4439-af94-e16bfa1d6161 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:27.396953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc834-cdf1-4439-af94-e16bfa1d6161 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:27.396953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc834-cdf1-4439-af94-e16bfa1d6161 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:27.398308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:27.403717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029d86-39c0-4b85-be64-1c4a4ce30227 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:27.404153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029d86-39c0-4b85-be64-1c4a4ce30227 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:27.404266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029d86-39c0-4b85-be64-1c4a4ce30227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:27.423133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3b029d86-39c0-4b85-be64-1c4a4ce30227 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:27.424324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3b029d86-39c0-4b85-be64-1c4a4ce30227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:27.432641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:27.470911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc834-cdf1-4439-af94-e16bfa1d6161 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:27.482424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc834-cdf1-4439-af94-e16bfa1d6161 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:27.486217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994f15b-c38b-47e7-847d-051de5e3176c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:27.486870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994f15b-c38b-47e7-847d-051de5e3176c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:27.487171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994f15b-c38b-47e7-847d-051de5e3176c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:27.487451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994f15b-c38b-47e7-847d-051de5e3176c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:27.496949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994f15b-c38b-47e7-847d-051de5e3176c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:27.498401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994f15b-c38b-47e7-847d-051de5e3176c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:27.507924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 725/1455] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:29.758444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdac61e-56d5-40df-ad3e-86efc475c1ef None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:29.759007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdac61e-56d5-40df-ad3e-86efc475c1ef None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:29.759007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdac61e-56d5-40df-ad3e-86efc475c1ef None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:29.760346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:29.765538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc88d8-7ec3-4cc3-a27d-e4e002df2cce None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:29.766024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc88d8-7ec3-4cc3-a27d-e4e002df2cce None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:29.766183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc88d8-7ec3-4cc3-a27d-e4e002df2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:29.786065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-aafc88d8-7ec3-4cc3-a27d-e4e002df2cce None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:29.787663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aafc88d8-7ec3-4cc3-a27d-e4e002df2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:29.795564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:02:29.834633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdac61e-56d5-40df-ad3e-86efc475c1ef None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:29.845588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdac61e-56d5-40df-ad3e-86efc475c1ef None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:29.849617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da944b9-ecb1-438e-8580-27292e82c547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:29.850251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da944b9-ecb1-438e-8580-27292e82c547 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:29.850535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da944b9-ecb1-438e-8580-27292e82c547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:29.850810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da944b9-ecb1-438e-8580-27292e82c547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:29.859962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da944b9-ecb1-438e-8580-27292e82c547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:29.861451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da944b9-ecb1-438e-8580-27292e82c547 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:29.871157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 732/1458] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:32.236957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516db95-45fa-4b40-8cb1-66b098f67a5a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:32.238230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516db95-45fa-4b40-8cb1-66b098f67a5a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:32.238230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516db95-45fa-4b40-8cb1-66b098f67a5a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:32.239636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:32.244645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731677-a88d-4247-bc6a-8345b74da691 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:32.245067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731677-a88d-4247-bc6a-8345b74da691 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:32.245237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731677-a88d-4247-bc6a-8345b74da691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:32.251327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=70 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:02:32.264312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5a731677-a88d-4247-bc6a-8345b74da691 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:32.265545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5a731677-a88d-4247-bc6a-8345b74da691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:32.274009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:32.312149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516db95-45fa-4b40-8cb1-66b098f67a5a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:32.317625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=73 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:02:32.323973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516db95-45fa-4b40-8cb1-66b098f67a5a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:32.327550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924c438-6994-4461-ab8f-045290ccda04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:32.328238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924c438-6994-4461-ab8f-045290ccda04 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:32.328520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924c438-6994-4461-ab8f-045290ccda04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:32.328841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924c438-6994-4461-ab8f-045290ccda04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:32.337931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924c438-6994-4461-ab8f-045290ccda04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:32.339365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924c438-6994-4461-ab8f-045290ccda04 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:32.349326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 728/1461] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:34.596441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ca9d-ed1f-4797-8511-404405073a2a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:34.597446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ca9d-ed1f-4797-8511-404405073a2a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:34.597446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337ca9d-ed1f-4797-8511-404405073a2a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:34.598394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:34.603809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bbb26-6ec4-4ea2-8c76-688783c27e38 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:34.604262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bbb26-6ec4-4ea2-8c76-688783c27e38 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:34.604431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bbb26-6ec4-4ea2-8c76-688783c27e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:34.622224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-148bbb26-6ec4-4ea2-8c76-688783c27e38 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:34.623458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-148bbb26-6ec4-4ea2-8c76-688783c27e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:34.633071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:34.671302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337ca9d-ed1f-4797-8511-404405073a2a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:34.682326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337ca9d-ed1f-4797-8511-404405073a2a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:34.685857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fa696-99ed-4892-a577-729e68329b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:34.686498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fa696-99ed-4892-a577-729e68329b33 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:34.687035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fa696-99ed-4892-a577-729e68329b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:34.687414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fa696-99ed-4892-a577-729e68329b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:34.697528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fa696-99ed-4892-a577-729e68329b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:34.698965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fa696-99ed-4892-a577-729e68329b33 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:34.709454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 735/1464] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:36.972719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc938-c9d9-4459-bb08-ac8b29de4d3d None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:36.973265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc938-c9d9-4459-bb08-ac8b29de4d3d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:36.973421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc938-c9d9-4459-bb08-ac8b29de4d3d None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:36.974928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:36.980388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910591-16e3-4a8b-821e-631ceb0aca93 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:36.980864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910591-16e3-4a8b-821e-631ceb0aca93 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:36.980971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910591-16e3-4a8b-821e-631ceb0aca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:37.000006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bb910591-16e3-4a8b-821e-631ceb0aca93 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:37.001235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb910591-16e3-4a8b-821e-631ceb0aca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:37.010480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:37.047329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc938-c9d9-4459-bb08-ac8b29de4d3d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:37.058776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc938-c9d9-4459-bb08-ac8b29de4d3d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:37.062558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8acde-3048-43ed-82cb-62ed4e0940d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:37.063189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8acde-3048-43ed-82cb-62ed4e0940d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:37.063472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8acde-3048-43ed-82cb-62ed4e0940d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:37.063750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8acde-3048-43ed-82cb-62ed4e0940d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:37.073253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8acde-3048-43ed-82cb-62ed4e0940d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:37.074690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8acde-3048-43ed-82cb-62ed4e0940d5 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:37.083925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 731/1467] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:39.302121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ebd3-d80e-4c9a-acc2-64f8710e4114 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:39.302636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ebd3-d80e-4c9a-acc2-64f8710e4114 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:39.302636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ebd3-d80e-4c9a-acc2-64f8710e4114 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:39.303991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:02:39.309627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f7d7-a8b5-482d-a52a-1aa3240841e3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:39.310040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f7d7-a8b5-482d-a52a-1aa3240841e3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:39.310212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f7d7-a8b5-482d-a52a-1aa3240841e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:39.328773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8818f7d7-a8b5-482d-a52a-1aa3240841e3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:02:39.329994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8818f7d7-a8b5-482d-a52a-1aa3240841e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:02:39.339142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:02:39.375531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ebd3-d80e-4c9a-acc2-64f8710e4114 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:02:39.386878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ebd3-d80e-4c9a-acc2-64f8710e4114 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:02:39.390393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cd798-545d-457a-9db7-520abc4ad4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:02:39.391025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd798-545d-457a-9db7-520abc4ad4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:02:39.391312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd798-545d-457a-9db7-520abc4ad4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:02:39.391588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd798-545d-457a-9db7-520abc4ad4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:02:39.400570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cd798-545d-457a-9db7-520abc4ad4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:02:39.402041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cd798-545d-457a-9db7-520abc4ad4a2 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:02:39.411530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 738/1470] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:02:49.323711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=17 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:02:49.407211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=17 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:03:12.814239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f4a7f-b138-4bc6-b449-a7995364456c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:12.815403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f4a7f-b138-4bc6-b449-a7995364456c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:12.815403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f4a7f-b138-4bc6-b449-a7995364456c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:12.817162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 733/1471] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:12.822330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5f78d-c0cd-44f2-bd1d-b7b613c89600 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:12.822805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5f78d-c0cd-44f2-bd1d-b7b613c89600 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:12.823043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5f78d-c0cd-44f2-bd1d-b7b613c89600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:12.841505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ade5f78d-c0cd-44f2-bd1d-b7b613c89600 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:12.842709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ade5f78d-c0cd-44f2-bd1d-b7b613c89600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:12.851085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 739/1472] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:03:12.898488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9517-9120-47e6-8480-aae259a7b982 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:12.898777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9517-9120-47e6-8480-aae259a7b982 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:12.899055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9517-9120-47e6-8480-aae259a7b982 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:12.900428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 734/1473] 10.222.0.31 () {54 vars in 962 bytes} [Wed May 25 17:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:12.905236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6247-9c32-4876-a2c2-69db59c2921f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:12.905529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6247-9c32-4876-a2c2-69db59c2921f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:12.905810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6247-9c32-4876-a2c2-69db59c2921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:12.923848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-defd6247-9c32-4876-a2c2-69db59c2921f None None] MFA Rules not processed for user `e29e245b61634d66bcca79fe530c6019`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:12.925220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-defd6247-9c32-4876-a2c2-69db59c2921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:12.931673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 740/1474] 10.222.0.31 () {58 vars in 1059 bytes} [Wed May 25 17:03:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:03:12.938975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9517-9120-47e6-8480-aae259a7b982 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:12.950200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9517-9120-47e6-8480-aae259a7b982 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:12.953715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8a61-a69b-427f-97f1-5e2ecc2fbf70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:12.954341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8a61-a69b-427f-97f1-5e2ecc2fbf70 service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:12.954631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8a61-a69b-427f-97f1-5e2ecc2fbf70 service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:12.954913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8a61-a69b-427f-97f1-5e2ecc2fbf70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:12.964790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d8a61-a69b-427f-97f1-5e2ecc2fbf70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:12.966253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d8a61-a69b-427f-97f1-5e2ecc2fbf70 service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:12.975835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 735/1475] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:03:15.296891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcdac-5668-4bec-a55b-063b000a4301 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:15.297445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcdac-5668-4bec-a55b-063b000a4301 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:15.297445 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcdac-5668-4bec-a55b-063b000a4301 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:15.298811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 741/1476] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:15.306509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d495-37e7-4bdf-a201-3111dc584405 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:15.307219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d495-37e7-4bdf-a201-3111dc584405 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:15.307898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d495-37e7-4bdf-a201-3111dc584405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:15.327948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cbb3d495-37e7-4bdf-a201-3111dc584405 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:15.329187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cbb3d495-37e7-4bdf-a201-3111dc584405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:15.337768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 736/1477] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:03:15.361297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcdac-5668-4bec-a55b-063b000a4301 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:15.373847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcdac-5668-4bec-a55b-063b000a4301 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:15.378551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:15.379195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:15.379482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:15.379762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:15.380489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:15.382309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:03:15.382309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:03:15.382309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:03:15.383468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301f898-9a95-48b2-ad5d-bcd5b869afd6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:15.408433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 742/1478] 10.222.0.31 () {56 vars in 1108 bytes} [Wed May 25 17:03:15 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:03:17.655437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ef3d-8b0d-483a-ac3e-ee2e5d2d502e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:17.656023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ef3d-8b0d-483a-ac3e-ee2e5d2d502e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:17.656023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ef3d-8b0d-483a-ac3e-ee2e5d2d502e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:17.657425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 737/1479] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:17.663450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a885-875d-4904-93a3-6678829eb85d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:17.663876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a885-875d-4904-93a3-6678829eb85d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:17.664031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a885-875d-4904-93a3-6678829eb85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:17.682742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-86f2a885-875d-4904-93a3-6678829eb85d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:17.683958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-86f2a885-875d-4904-93a3-6678829eb85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:17.692982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 743/1480] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:03:17.735736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ef3d-8b0d-483a-ac3e-ee2e5d2d502e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:17.750902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ef3d-8b0d-483a-ac3e-ee2e5d2d502e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:17.757350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398e03-1f62-4c70-9011-a0bd03fd21c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:17.757982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398e03-1f62-4c70-9011-a0bd03fd21c4 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:17.758262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398e03-1f62-4c70-9011-a0bd03fd21c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:17.758541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398e03-1f62-4c70-9011-a0bd03fd21c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:17.766485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398e03-1f62-4c70-9011-a0bd03fd21c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:17.768589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398e03-1f62-4c70-9011-a0bd03fd21c4 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:17.777918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 738/1481] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:03:20.163174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb2f13-252b-4848-ab1a-bc86cda08403 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:20.163754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb2f13-252b-4848-ab1a-bc86cda08403 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:20.163754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb2f13-252b-4848-ab1a-bc86cda08403 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:20.165106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 744/1482] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:20.170317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7eef-9714-4e39-b7d8-48fec02e5877 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:20.170712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7eef-9714-4e39-b7d8-48fec02e5877 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:20.170882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7eef-9714-4e39-b7d8-48fec02e5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:20.188956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cfbe7eef-9714-4e39-b7d8-48fec02e5877 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:20.190775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cfbe7eef-9714-4e39-b7d8-48fec02e5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:20.198890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 739/1483] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:03:20.236627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb2f13-252b-4848-ab1a-bc86cda08403 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:20.247801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb2f13-252b-4848-ab1a-bc86cda08403 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:20.251463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0c651-2892-4e22-a036-2b0fdaa267f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:20.252108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c651-2892-4e22-a036-2b0fdaa267f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:20.253043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c651-2892-4e22-a036-2b0fdaa267f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:20.253323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0c651-2892-4e22-a036-2b0fdaa267f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:20.262417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0c651-2892-4e22-a036-2b0fdaa267f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:20.263854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0c651-2892-4e22-a036-2b0fdaa267f9 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:20.273776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 745/1484] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:03:22.563800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3448-0ff1-4026-b38f-d90797597c2e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:22.564369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3448-0ff1-4026-b38f-d90797597c2e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:22.564369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3448-0ff1-4026-b38f-d90797597c2e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:22.566260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 740/1485] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:22.571478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd532e6-6370-4992-84e1-24de77235183 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:22.571956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd532e6-6370-4992-84e1-24de77235183 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:22.572053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd532e6-6370-4992-84e1-24de77235183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:22.591313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8fd532e6-6370-4992-84e1-24de77235183 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:22.592512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8fd532e6-6370-4992-84e1-24de77235183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:22.600606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 746/1486] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:03:22.637963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3448-0ff1-4026-b38f-d90797597c2e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:22.649881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3448-0ff1-4026-b38f-d90797597c2e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:22.653410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdada0-9038-48fc-9412-0ca1b5855900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:22.654044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdada0-9038-48fc-9412-0ca1b5855900 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:22.654327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdada0-9038-48fc-9412-0ca1b5855900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:22.654604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdada0-9038-48fc-9412-0ca1b5855900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:22.663951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdada0-9038-48fc-9412-0ca1b5855900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:22.665420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdada0-9038-48fc-9412-0ca1b5855900 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:22.674831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 741/1487] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:03:25.027448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ce6e-08f5-40e1-b848-361afce8abe6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:25.028028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ce6e-08f5-40e1-b848-361afce8abe6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:25.028028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ce6e-08f5-40e1-b848-361afce8abe6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:25.029395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 747/1488] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:25.035438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a5ba-29a9-4c6a-ba3d-715cbff9e77e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:25.035882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a5ba-29a9-4c6a-ba3d-715cbff9e77e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:25.035991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954a5ba-29a9-4c6a-ba3d-715cbff9e77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:25.053581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e954a5ba-29a9-4c6a-ba3d-715cbff9e77e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:25.054788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e954a5ba-29a9-4c6a-ba3d-715cbff9e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:25.062617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 742/1489] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:03:25.103795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ce6e-08f5-40e1-b848-361afce8abe6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:25.115172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ce6e-08f5-40e1-b848-361afce8abe6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:25.118864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f8de6-9871-4f0d-83bf-4cf7263d9e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:25.119516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f8de6-9871-4f0d-83bf-4cf7263d9e92 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:25.119803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f8de6-9871-4f0d-83bf-4cf7263d9e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:25.120093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f8de6-9871-4f0d-83bf-4cf7263d9e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:25.129804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f8de6-9871-4f0d-83bf-4cf7263d9e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:25.131294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f8de6-9871-4f0d-83bf-4cf7263d9e92 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:25.141034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 748/1490] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:03:27.577395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990e529-d0ea-4d5f-9004-8d26458670f7 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:27.577955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990e529-d0ea-4d5f-9004-8d26458670f7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:27.577955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990e529-d0ea-4d5f-9004-8d26458670f7 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:27.579319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 743/1491] 10.222.0.31 () {54 vars in 926 bytes} [Wed May 25 17:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:03:27.585340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457c71-1685-4fe6-9baa-73887f6871e2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:27.585787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457c71-1685-4fe6-9baa-73887f6871e2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:27.585904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457c71-1685-4fe6-9baa-73887f6871e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:27.604056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6b457c71-1685-4fe6-9baa-73887f6871e2 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:03:27.605297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6b457c71-1685-4fe6-9baa-73887f6871e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:03:27.613676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 749/1492] 10.222.0.31 () {58 vars in 1023 bytes} [Wed May 25 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:03:27.653387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990e529-d0ea-4d5f-9004-8d26458670f7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:03:27.669704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990e529-d0ea-4d5f-9004-8d26458670f7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:03:27.673400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c566cd-de3a-48e4-b7b1-ab217bb3180e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:03:27.674079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c566cd-de3a-48e4-b7b1-ab217bb3180e service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:03:27.674384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c566cd-de3a-48e4-b7b1-ab217bb3180e service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:03:27.674660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c566cd-de3a-48e4-b7b1-ab217bb3180e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:03:27.684872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c566cd-de3a-48e4-b7b1-ab217bb3180e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:03:27.686420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c566cd-de3a-48e4-b7b1-ab217bb3180e service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:03:27.697282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 744/1493] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:03:37.598966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=33 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:03:37.692766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=33 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:05:21.667356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.667947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.667947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.686999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:05:21.688205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:21.697052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 750/1494] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:05:21.706336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.706839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.707000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.724949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:05:21.726139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:21.733947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 745/1495] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:05:21.738852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:21.748355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e05cc-2a73-49f6-b987-0713e49f3d5d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:21.752811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:21.753455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.753834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.754665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.755451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:05:21.755767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:21.756801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:21.756801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:05:21.756801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:05:21.757708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:21.769029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 751/1496] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:05:21.776886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:21.786157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc76897-e0e2-4292-9db6-2e18a923a8df None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:21.790757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:21.791404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.791686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.791962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.792649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:21.794449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:21.794449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:05:21.794449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:05:21.795639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:21.833791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 746/1497] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:05:21 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:05:21.837954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:21.848982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282666b-5ec8-4f98-bca8-742d71f885d9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:21.905383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:21.906043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.906327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.906603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.907289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:21.908304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:21.908304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:05:21.908304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:05:21.909541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:21.930101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 752/1498] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:05:21 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:05:21.934152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:21.944836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9db7ef-2a6b-4098-ada1-4f1557bd7dcc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:21.949333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:21.949993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.950278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.950592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.951349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:21.952369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:21.952369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:05:21.952369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:05:21.953302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:21.966561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 747/1499] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:05:21.970538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:21.981122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd622061-0e4a-4169-8c33-eb3d8e10357e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:21.985627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:21.986280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:21.986564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:21.986839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:21.987549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:21.988581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:21.988581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:05:21.988581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:05:21.989519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24a40-6cf7-4e40-85c8-601bcf78ef5f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:22.002790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 753/1500] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:05:22.006971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:22.016988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979befd-f161-42f4-a5d0-03223aabbe23 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:22.021992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:22.022865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.023139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.023407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] PATH_INFO: `/v3/projects/8e8b6ad972d44c969b151bea76470e92/users/a4077b1624404362a122809e8aa3287b/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.039269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8b6ad972d44c969b151bea76470e92, user_id=a4077b1624404362a122809e8aa3287b, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:22.040333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:22.040333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:05:22.040333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:05:22.042309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b993df5-65e6-46aa-bb68-501f1c18b5d9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:22.054972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 748/1501] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:05:22 2022] PUT /identity/v3/projects/8e8b6ad972d44c969b151bea76470e92/users/a4077b1624404362a122809e8aa3287b/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:05:22.067166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9f97e-abf1-426b-ad26-8165117b8ded None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.067461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9f97e-abf1-426b-ad26-8165117b8ded None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.067740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9f97e-abf1-426b-ad26-8165117b8ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.094028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5fb9f97e-abf1-426b-ad26-8165117b8ded None None] MFA Rules not processed for user `a4077b1624404362a122809e8aa3287b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:05:22.095271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5fb9f97e-abf1-426b-ad26-8165117b8ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:22.158026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 754/1502] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:05:22.171443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d950d3-d4c8-4a37-9c4b-49bc5ed1a32b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.171727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d950d3-d4c8-4a37-9c4b-49bc5ed1a32b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.172000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d950d3-d4c8-4a37-9c4b-49bc5ed1a32b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.173405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 749/1503] 10.222.0.31 () {54 vars in 963 bytes} [Wed May 25 17:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:05:22.178639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76379b-86f8-4931-823e-fd5353f56b55 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.178933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76379b-86f8-4931-823e-fd5353f56b55 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.179216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76379b-86f8-4931-823e-fd5353f56b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.197568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0c76379b-86f8-4931-823e-fd5353f56b55 None None] MFA Rules not processed for user `ca966a266e17460b8e38790f506eb406`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:05:22.198713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0c76379b-86f8-4931-823e-fd5353f56b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:22.241220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:05:22.249468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 755/1504] 10.222.0.31 () {58 vars in 1060 bytes} [Wed May 25 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:05:22.257845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d950d3-d4c8-4a37-9c4b-49bc5ed1a32b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:22.268391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d950d3-d4c8-4a37-9c4b-49bc5ed1a32b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:22.272439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:22.273089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.273367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.273640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.281627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:22.283080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:22.291774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 750/1505] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:05:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:05:22.337538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14163-69fc-4d11-843a-afbfa7a59cd1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.337832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14163-69fc-4d11-843a-afbfa7a59cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.338125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14163-69fc-4d11-843a-afbfa7a59cd1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.339378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 756/1506] 10.222.0.31 () {52 vars in 829 bytes} [Wed May 25 17:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:05:22.342985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:22.402726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc80e3-5d71-441a-a2f3-bdf07f26151d service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:22.407214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:22.408071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.408350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.408639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] PATH_INFO: `/v3/users/a4077b1624404362a122809e8aa3287b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.409814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4077b1624404362a122809e8aa3287b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:22.410874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:22.410874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:05:22.410874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:05:22.412107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:22.477386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4077b1624404362a122809e8aa3287b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:22.478255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4077b1624404362a122809e8aa3287b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:22.479094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4077b1624404362a122809e8aa3287b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:22.500894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4077b1624404362a122809e8aa3287b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:22.513467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4077b1624404362a122809e8aa3287b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:22.517410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:05:22.530795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 751/1507] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:05:22 2022] DELETE /identity/v3/users/a4077b1624404362a122809e8aa3287b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:05:22.535391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.535746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.536024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.553637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:05:22.554887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:22.612636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 757/1508] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:05:22.624099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:22.625538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:22.686896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032dfa-541e-4783-b760-b5684ca4b73f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:22.690815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568dea-0955-42fd-bb3e-d6a78041900f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:22.692615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568dea-0955-42fd-bb3e-d6a78041900f service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:22.693278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568dea-0955-42fd-bb3e-d6a78041900f service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:22.693278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568dea-0955-42fd-bb3e-d6a78041900f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:22.702078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89568dea-0955-42fd-bb3e-d6a78041900f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:22.703528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89568dea-0955-42fd-bb3e-d6a78041900f service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:22.713412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 752/1509] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:05:23.048430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:05:23.050071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:05:23.062520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e9f23-9309-42bf-a719-d15b1815bbcf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:05:23.068987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:05:23.070211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:05:23.070489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:05:23.070774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] PATH_INFO: `/v3/projects/8e8b6ad972d44c969b151bea76470e92` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:05:23.071937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8b6ad972d44c969b151bea76470e92)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:05:23.074177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:05:23.074177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:05:23.074177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:05:23.075519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:05:23.138958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8b6ad972d44c969b151bea76470e92', 'request_id': 'req-9c40d618-fb33-4774-838e-be463a1917eb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:23.145434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8b6ad972d44c969b151bea76470e92', 'request_id': 'req-9c40d618-fb33-4774-838e-be463a1917eb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:23.158355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8b6ad972d44c969b151bea76470e92', 'request_id': 'req-9c40d618-fb33-4774-838e-be463a1917eb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:23.172924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] The token cache is being invalidate because project 8e8b6ad972d44c969b151bea76470e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:05:23.173216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:23.173910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9c40d618-fb33-4774-838e-be463a1917eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:05:23.175421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 758/1510] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:05:23 2022] DELETE /identity/v3/projects/8e8b6ad972d44c969b151bea76470e92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:05:32.709144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:05:33.169930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:02.329156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5a98-b2e9-4b90-b7e6-4ab1ed5a1c0e None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:02.329844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5a98-b2e9-4b90-b7e6-4ab1ed5a1c0e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:02.329844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5a98-b2e9-4b90-b7e6-4ab1ed5a1c0e None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:02.331104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:02.337259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5222b-5d9c-4d73-a85b-7cf7f69e2402 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:02.337752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5222b-5d9c-4d73-a85b-7cf7f69e2402 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:02.337861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5222b-5d9c-4d73-a85b-7cf7f69e2402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:02.357161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-61b5222b-5d9c-4d73-a85b-7cf7f69e2402 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:02.358382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-61b5222b-5d9c-4d73-a85b-7cf7f69e2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:02.417657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:07:02.591071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5a98-b2e9-4b90-b7e6-4ab1ed5a1c0e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:02.592924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8bed5a98-b2e9-4b90-b7e6-4ab1ed5a1c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:02.667600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5a98-b2e9-4b90-b7e6-4ab1ed5a1c0e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:02.674086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c8ab-251d-4b2e-bb54-fadb17f7ec61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:02.675326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c8ab-251d-4b2e-bb54-fadb17f7ec61 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:02.675556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c8ab-251d-4b2e-bb54-fadb17f7ec61 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:02.675842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c8ab-251d-4b2e-bb54-fadb17f7ec61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:02.688044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c8ab-251d-4b2e-bb54-fadb17f7ec61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:02.689986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c8ab-251d-4b2e-bb54-fadb17f7ec61 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:02.701402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 754/1513] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:03.587897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc77043-92a0-4157-8540-20a918d4889c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:03.588483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc77043-92a0-4157-8540-20a918d4889c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:03.588483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc77043-92a0-4157-8540-20a918d4889c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:03.589870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:03.594807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad329ab-8ac4-4873-b02d-57efd6fc854f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:03.595252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad329ab-8ac4-4873-b02d-57efd6fc854f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:03.595499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad329ab-8ac4-4873-b02d-57efd6fc854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:03.614086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cad329ab-8ac4-4873-b02d-57efd6fc854f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:03.615953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cad329ab-8ac4-4873-b02d-57efd6fc854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:03.623850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:03.630211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ef7f1-cb95-4d25-a348-25c1a24c6b06 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:03.630509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ef7f1-cb95-4d25-a348-25c1a24c6b06 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:03.631369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ef7f1-cb95-4d25-a348-25c1a24c6b06 None None] PATH_INFO: `/v3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:03.633666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 761/1516] 10.222.0.71 () {54 vars in 925 bytes} [Wed May 25 17:07:03 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:07:03.639224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d62f1-7943-4556-93c6-80930c852af8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:03.639585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d62f1-7943-4556-93c6-80930c852af8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:03.639936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d62f1-7943-4556-93c6-80930c852af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:03.657818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1c7d62f1-7943-4556-93c6-80930c852af8 None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:03.659052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1c7d62f1-7943-4556-93c6-80930c852af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:03.724603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 756/1517] 10.222.0.71 () {58 vars in 1015 bytes} [Wed May 25 17:07:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:07:03.777143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ef7f1-cb95-4d25-a348-25c1a24c6b06 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:03.796695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ef7f1-cb95-4d25-a348-25c1a24c6b06 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:03.805200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470d31-974d-48a6-9a10-02a51e00e672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:03.805869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470d31-974d-48a6-9a10-02a51e00e672 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:03.806156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470d31-974d-48a6-9a10-02a51e00e672 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:03.806434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470d31-974d-48a6-9a10-02a51e00e672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:03.815729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2470d31-974d-48a6-9a10-02a51e00e672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:03.817440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2470d31-974d-48a6-9a10-02a51e00e672 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:03.829479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 762/1518] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:07.597086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e87f-b97d-41ae-86f0-0a91d38402b2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:07.597621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e87f-b97d-41ae-86f0-0a91d38402b2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:07.597621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e87f-b97d-41ae-86f0-0a91d38402b2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:07.598986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 757/1519] 10.222.0.31 () {54 vars in 960 bytes} [Wed May 25 17:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:07.604887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b430-3754-429c-8e02-b868ac545c5e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:07.605301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b430-3754-429c-8e02-b868ac545c5e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:07.605587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b430-3754-429c-8e02-b868ac545c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:07.623968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5df9b430-3754-429c-8e02-b868ac545c5e None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:07.625216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5df9b430-3754-429c-8e02-b868ac545c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:07.633931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 763/1520] 10.222.0.31 () {58 vars in 1057 bytes} [Wed May 25 17:07:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:07.641534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e87f-b97d-41ae-86f0-0a91d38402b2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:07.656275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e87f-b97d-41ae-86f0-0a91d38402b2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:07.661362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e726-1fd1-49a6-8bb8-1b52cdce4d64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:07.662646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e726-1fd1-49a6-8bb8-1b52cdce4d64 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:07.663051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e726-1fd1-49a6-8bb8-1b52cdce4d64 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:07.663340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e726-1fd1-49a6-8bb8-1b52cdce4d64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:07.672082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454e726-1fd1-49a6-8bb8-1b52cdce4d64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:07.673723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454e726-1fd1-49a6-8bb8-1b52cdce4d64 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:07.683552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 758/1521] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:15.105924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98f913-46e9-45a9-a390-c9bfeb9ef133 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:15.106406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98f913-46e9-45a9-a390-c9bfeb9ef133 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:15.106597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98f913-46e9-45a9-a390-c9bfeb9ef133 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:15.107816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:15.112489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c026-effc-4488-9c57-5f15b0605a0b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:15.112951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c026-effc-4488-9c57-5f15b0605a0b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:15.113091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c026-effc-4488-9c57-5f15b0605a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:15.133584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2ed0c026-effc-4488-9c57-5f15b0605a0b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:15.134791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2ed0c026-effc-4488-9c57-5f15b0605a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:15.142602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:15.299271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98f913-46e9-45a9-a390-c9bfeb9ef133 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:15.314234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98f913-46e9-45a9-a390-c9bfeb9ef133 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:15.320814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c1825-5e99-46f5-a98d-ba8525b1267c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:15.321451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c1825-5e99-46f5-a98d-ba8525b1267c service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:15.321735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c1825-5e99-46f5-a98d-ba8525b1267c service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:15.322015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c1825-5e99-46f5-a98d-ba8525b1267c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:15.330076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c1825-5e99-46f5-a98d-ba8525b1267c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:15.331677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c1825-5e99-46f5-a98d-ba8525b1267c service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:15.343035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 765/1524] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:16.219497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01805-29c4-4431-af8f-f023c322a06a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:16.220052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01805-29c4-4431-af8f-f023c322a06a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:16.220052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01805-29c4-4431-af8f-f023c322a06a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:16.221473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 17:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:16.226486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691413-65ec-4e5f-9d19-fe781ba4f126 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:16.226911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691413-65ec-4e5f-9d19-fe781ba4f126 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:16.227052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691413-65ec-4e5f-9d19-fe781ba4f126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:16.245275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c5691413-65ec-4e5f-9d19-fe781ba4f126 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:16.246488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c5691413-65ec-4e5f-9d19-fe781ba4f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:16.254287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 17:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:16.411143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01805-29c4-4431-af8f-f023c322a06a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:16.425618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01805-29c4-4431-af8f-f023c322a06a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:16.431963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf25b4-17d3-4609-97ea-6e06e31136e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:16.432591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf25b4-17d3-4609-97ea-6e06e31136e9 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:16.432896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf25b4-17d3-4609-97ea-6e06e31136e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:16.433171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf25b4-17d3-4609-97ea-6e06e31136e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:16.441342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf25b4-17d3-4609-97ea-6e06e31136e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:16.443992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf25b4-17d3-4609-97ea-6e06e31136e9 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:16.453187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 761/1527] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:20.633470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d20e-f899-4c11-8fed-c681bf49ea6d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:20.634060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d20e-f899-4c11-8fed-c681bf49ea6d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:20.634060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d20e-f899-4c11-8fed-c681bf49ea6d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:20.635411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:20.640610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c1be-93af-4681-815d-620d94be7043 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:20.641034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c1be-93af-4681-815d-620d94be7043 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:20.641210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c1be-93af-4681-815d-620d94be7043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:20.659273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2c82c1be-93af-4681-815d-620d94be7043 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:20.660487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2c82c1be-93af-4681-815d-620d94be7043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:20.669294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:20.706907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d20e-f899-4c11-8fed-c681bf49ea6d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:20.708627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-af62d20e-f899-4c11-8fed-c681bf49ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:20.766248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d20e-f899-4c11-8fed-c681bf49ea6d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:20.769780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843219e-a8ad-42cb-b6e7-ab93353e1fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:20.770422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843219e-a8ad-42cb-b6e7-ab93353e1fcf service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:20.770734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843219e-a8ad-42cb-b6e7-ab93353e1fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:20.771246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843219e-a8ad-42cb-b6e7-ab93353e1fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:20.780268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843219e-a8ad-42cb-b6e7-ab93353e1fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:20.781735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843219e-a8ad-42cb-b6e7-ab93353e1fcf service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:20.791657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 768/1530] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:23.051368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadad2c-baf5-40d3-b1ea-a933060012f0 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:23.052432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadad2c-baf5-40d3-b1ea-a933060012f0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:23.052432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadad2c-baf5-40d3-b1ea-a933060012f0 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:23.053955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:23.059377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfe38-ce0e-4043-9df3-b1bff9dd6226 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:23.059782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfe38-ce0e-4043-9df3-b1bff9dd6226 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:23.059937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfe38-ce0e-4043-9df3-b1bff9dd6226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:23.078504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-96fbfe38-ce0e-4043-9df3-b1bff9dd6226 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:23.079679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-96fbfe38-ce0e-4043-9df3-b1bff9dd6226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:23.087304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:23.122881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadad2c-baf5-40d3-b1ea-a933060012f0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:23.124560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-eaadad2c-baf5-40d3-b1ea-a933060012f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:23.133220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:23.139722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadad2c-baf5-40d3-b1ea-a933060012f0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:23.143221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02e1d9-6202-4202-810a-2e42c854ffb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:23.143854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02e1d9-6202-4202-810a-2e42c854ffb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:23.144152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02e1d9-6202-4202-810a-2e42c854ffb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:23.144401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02e1d9-6202-4202-810a-2e42c854ffb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:23.153175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02e1d9-6202-4202-810a-2e42c854ffb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:23.154597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02e1d9-6202-4202-810a-2e42c854ffb8 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:23.163753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 764/1533] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:27.365649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f529-28ad-4f7b-ab6e-fc79745d3987 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:27.366181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f529-28ad-4f7b-ab6e-fc79745d3987 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:27.366181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f529-28ad-4f7b-ab6e-fc79745d3987 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:27.367512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:27.373189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb7c09-e77d-4dd9-8a09-1aa62ad356a1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:27.373587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb7c09-e77d-4dd9-8a09-1aa62ad356a1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:27.373771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb7c09-e77d-4dd9-8a09-1aa62ad356a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:27.391563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-faeb7c09-e77d-4dd9-8a09-1aa62ad356a1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:27.392912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-faeb7c09-e77d-4dd9-8a09-1aa62ad356a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:27.400663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:27.670285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613f529-28ad-4f7b-ab6e-fc79745d3987 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:27.671938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5613f529-28ad-4f7b-ab6e-fc79745d3987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:27.678304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=75 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:27.736115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613f529-28ad-4f7b-ab6e-fc79745d3987 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:27.740243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bab0e5-22e3-47d5-a100-10cb8a71bf89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:27.740932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bab0e5-22e3-47d5-a100-10cb8a71bf89 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:27.741247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bab0e5-22e3-47d5-a100-10cb8a71bf89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:27.741524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bab0e5-22e3-47d5-a100-10cb8a71bf89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:27.750971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bab0e5-22e3-47d5-a100-10cb8a71bf89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:27.752412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bab0e5-22e3-47d5-a100-10cb8a71bf89 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:27.763859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 771/1536] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:30.050780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f8e94-bd10-484b-9eee-8cf48f6d56c2 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:30.051295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f8e94-bd10-484b-9eee-8cf48f6d56c2 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:30.051295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f8e94-bd10-484b-9eee-8cf48f6d56c2 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:30.056589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 17:07:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:07:30.061936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81144-da94-4706-9256-d491e7e4687a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:30.062350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81144-da94-4706-9256-d491e7e4687a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:30.062500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81144-da94-4706-9256-d491e7e4687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:30.081284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ddb81144-da94-4706-9256-d491e7e4687a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:07:30.082485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ddb81144-da94-4706-9256-d491e7e4687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:30.090647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 17:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:07:30.368263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f8e94-bd10-484b-9eee-8cf48f6d56c2 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:07:30.369938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f55f8e94-bd10-484b-9eee-8cf48f6d56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:07:30.382803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f8e94-bd10-484b-9eee-8cf48f6d56c2 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:07:30.386274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ab68-c779-4c96-a1fb-58e1a0f34877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:07:30.386917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ab68-c779-4c96-a1fb-58e1a0f34877 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:07:30.387179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ab68-c779-4c96-a1fb-58e1a0f34877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:07:30.387452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ab68-c779-4c96-a1fb-58e1a0f34877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:07:30.396110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ab68-c779-4c96-a1fb-58e1a0f34877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:07:30.397562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ab68-c779-4c96-a1fb-58e1a0f34877 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:07:30.406626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 767/1539] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:07:40.076044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=28 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:07:40.402685 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=14 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:02.903264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:02.904028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:02.904028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:02.930560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:02.931877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:02.948531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 773/1540] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:02.960632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:02.961236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:02.961236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:02.993197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:02.994472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.005504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 768/1541] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:03.010755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.022962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca1e5-6eed-48cf-b103-19655487a67e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.033335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.034027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.034308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.034587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.036144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:03.036465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.038176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.053909 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 774/1542] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:03.063009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.073771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8149d-94f5-4795-8bc5-b8025b5b4418 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.085711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f3a8-96e4-4ae8-8061-9bf49082c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.086408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f3a8-96e4-4ae8-8061-9bf49082c44b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.086689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f3a8-96e4-4ae8-8061-9bf49082c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.086961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f3a8-96e4-4ae8-8061-9bf49082c44b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.087667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f3a8-96e4-4ae8-8061-9bf49082c44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.089697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f3a8-96e4-4ae8-8061-9bf49082c44b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.131958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 769/1543] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:03.136357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.164229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002383-f045-470b-94c7-9a4a66ee781b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.241392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100f9f2-1c56-41db-a335-08feb7e2af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.242005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100f9f2-1c56-41db-a335-08feb7e2af55 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.242291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100f9f2-1c56-41db-a335-08feb7e2af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.242423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.242621 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100f9f2-1c56-41db-a335-08feb7e2af55 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.242837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.243272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100f9f2-1c56-41db-a335-08feb7e2af55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.243389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.246050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100f9f2-1c56-41db-a335-08feb7e2af55 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.274603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 775/1544] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:03.275942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0fad-9788-42dc-b32d-e9fc5c2bb945 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.276232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0fad-9788-42dc-b32d-e9fc5c2bb945 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.276512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0fad-9788-42dc-b32d-e9fc5c2bb945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.281562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.283674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.306060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 770/1545] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.307011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.318319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-047a0fad-9788-42dc-b32d-e9fc5c2bb945 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.319861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-047a0fad-9788-42dc-b32d-e9fc5c2bb945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.331361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a1bf-4844-4924-80fc-14256cede7fa None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.337701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 776/1546] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.338861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76df1-ae52-460d-9b2f-4044bdb9cc70 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.339161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76df1-ae52-460d-9b2f-4044bdb9cc70 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.339495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76df1-ae52-460d-9b2f-4044bdb9cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.343571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af4085-286a-40fd-9300-e82f30e20bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.343755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af4085-286a-40fd-9300-e82f30e20bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.343951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af4085-286a-40fd-9300-e82f30e20bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.344227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af4085-286a-40fd-9300-e82f30e20bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.344989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af4085-286a-40fd-9300-e82f30e20bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.346664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af4085-286a-40fd-9300-e82f30e20bdb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.368268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 771/1547] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:03.369674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92714425-e657-4603-a402-30ecfc8d86de None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.369972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92714425-e657-4603-a402-30ecfc8d86de None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.370248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92714425-e657-4603-a402-30ecfc8d86de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.378051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-11a76df1-ae52-460d-9b2f-4044bdb9cc70 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.380023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-11a76df1-ae52-460d-9b2f-4044bdb9cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.400597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-92714425-e657-4603-a402-30ecfc8d86de None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.401866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-92714425-e657-4603-a402-30ecfc8d86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.403139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 777/1548] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.404620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229f85-5851-4a0d-bd52-b9b8a8d30534 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.404960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229f85-5851-4a0d-bd52-b9b8a8d30534 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.405258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229f85-5851-4a0d-bd52-b9b8a8d30534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.427561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 772/1549] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.428194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92714425-e657-4603-a402-30ecfc8d86de None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.444351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4f229f85-5851-4a0d-bd52-b9b8a8d30534 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.447981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4f229f85-5851-4a0d-bd52-b9b8a8d30534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.455109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92714425-e657-4603-a402-30ecfc8d86de None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.462550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 778/1550] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.463882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85c2d-0105-4a34-8404-1101fe501605 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.464169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85c2d-0105-4a34-8404-1101fe501605 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.464440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85c2d-0105-4a34-8404-1101fe501605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.467735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.468565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.468881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.469157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.469886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.471534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.489236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 773/1551] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:03.490586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.501471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2bc85c2d-0105-4a34-8404-1101fe501605 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.502590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2bc85c2d-0105-4a34-8404-1101fe501605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.508209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719878a-70aa-4748-bdde-9f806637409a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.513744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 779/1552] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.514454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.515165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.515287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc396e6-45ae-4dc8-8473-c543a41a1a2d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.515457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.515711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.515824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc396e6-45ae-4dc8-8473-c543a41a1a2d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.516010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc396e6-45ae-4dc8-8473-c543a41a1a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.516445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:03.516788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.517827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 17:09:03.517827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:09:03.517827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:09:03.518711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.536840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 774/1553] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:03.536840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.541424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-dcc396e6-45ae-4dc8-8473-c543a41a1a2d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.542764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-dcc396e6-45ae-4dc8-8473-c543a41a1a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.547193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d0c65-b571-49f2-959d-2c64cb558bff admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.554936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 780/1554] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.558480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2a1c-2bac-44c2-ac56-0d4725e7c4ab None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.558480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2a1c-2bac-44c2-ac56-0d4725e7c4ab None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.558480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2a1c-2bac-44c2-ac56-0d4725e7c4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.570070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.570763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.571038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.571313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.572042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:03.572350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.573998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.585373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a2ce2a1c-2bac-44c2-ac56-0d4725e7c4ab None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.586623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a2ce2a1c-2bac-44c2-ac56-0d4725e7c4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.587066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 775/1555] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:03.587884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.598419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9df32-deae-4be9-ad69-bc6c723dc57f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.599925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 781/1556] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.601365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.601663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.602086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.606782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.607954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.608392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.608986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] PATH_INFO: `/v3/projects/23a454e276d3405a93a67513e1a12126/users/83e111e4a0df4636ac9dc837f511e487/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.626912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.627142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a454e276d3405a93a67513e1a12126, user_id=83e111e4a0df4636ac9dc837f511e487, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.628119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.630276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.637211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 782/1557] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.638044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.647921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123aa47-5ada-4870-ac68-517dffb63efc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.648732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 776/1558] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:03 2022] PUT /identity/v3/projects/23a454e276d3405a93a67513e1a12126/users/83e111e4a0df4636ac9dc837f511e487/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:03.649555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.708650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.709349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.709636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.709920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.710672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:03.710985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.712620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8ebcf-4c54-4c61-bc57-f4d4c0fc9cd0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.713991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535518b-5c81-4499-b0f8-6d7cae6d73a1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.719171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f4339-47c2-47de-99b9-2925187884e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.719829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4339-47c2-47de-99b9-2925187884e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.720109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4339-47c2-47de-99b9-2925187884e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.720382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4339-47c2-47de-99b9-2925187884e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.721140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f4339-47c2-47de-99b9-2925187884e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.723314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f4339-47c2-47de-99b9-2925187884e9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.724162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 783/1559] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:03.725417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.725711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.725995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.743964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.745393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.754585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 784/1560] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.755670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.755800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 777/1561] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:03.757073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf974da-7f4a-44f9-be01-dc256fa4c278 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.757365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf974da-7f4a-44f9-be01-dc256fa4c278 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.757645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf974da-7f4a-44f9-be01-dc256fa4c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.767795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68234884-b3d9-4966-8574-be3e3b276779 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.775710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:03.776021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0cf974da-7f4a-44f9-be01-dc256fa4c278 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.777281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0cf974da-7f4a-44f9-be01-dc256fa4c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.810694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:03.839919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.840726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.841070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.841422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.842186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:03.843423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:09:03.843423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:09:03.843423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:09:03.845064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a454d-2fbb-4d76-9fea-e1db8bed66a9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:03.847982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 778/1562] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.853177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e9a26-69e7-4a0d-b840-2e73c74c0160 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.853544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e9a26-69e7-4a0d-b840-2e73c74c0160 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.853970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e9a26-69e7-4a0d-b840-2e73c74c0160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.875102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-312e9a26-69e7-4a0d-b840-2e73c74c0160 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.876429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-312e9a26-69e7-4a0d-b840-2e73c74c0160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.882741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 785/1563] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:03.884887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.885350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.886087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.888755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 779/1564] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.889991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.890280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.890558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:03.913455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.914685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.915671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:03.917401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:03.982113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 786/1565] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:03.982971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:03.993481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575326-1f53-49fe-88a5-b616557e57ec None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:03.998289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:03.998975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:03.999279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:03.999553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.000276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.002272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.031530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 787/1566] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.032296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.099994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52390b27-f492-490b-ac36-f01f603a411b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.105006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.105669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.105954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.106219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.106938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:04.107246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.108875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.114760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 780/1567] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:04.115676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.125414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615d4d2-aa8b-4ba2-a1c5-59115bc9610b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.128119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 788/1568] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:04.129057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.130596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.131407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.131763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.132103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.132925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.134020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:09:04.134020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:09:04.134020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:09:04.135385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.138730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98751055-8ad7-4be5-bdbc-4438d7fadb62 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.143436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.144086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.144376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.144659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.145421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:04.145819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.147344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e7634-1e4d-4734-af8e-9b5793a3b805 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.150014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:04.157869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 781/1569] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.161609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.161898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 789/1570] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:04.163230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.163530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.163809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.171773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4419ec-1738-4894-afee-8b986c74e8d7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.177072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.177728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.178010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.178285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.178986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.180946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.185269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:04.186488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:04.195944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 790/1571] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:04.199673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.204941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 782/1572] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.205799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.206789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6948-e391-4a7f-bb1d-26519ee6e2e3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.211822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.212480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.212797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.213083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.213834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:04.214148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.215747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.217041 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435daa5e-7359-496c-8b66-561f2bbc9e84 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.221614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.222262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.223074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.223346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.224065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.226009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.229268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 791/1573] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:04.230177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.252158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 783/1574] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.252158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.260383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d3b57-5907-40b9-9002-f85251b11ad7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.266239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.266909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.267192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.267470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.268153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.271230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.299222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 784/1575] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.300324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.300965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d093-a240-4d2e-8bed-ca82fb193f33 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.351344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.351997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.352283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.352563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.353662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:04.366530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8dfd-a93d-48df-af83-61f6b6f08946 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.370997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.371660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.371941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.372214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.372967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.374563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.384876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 785/1576] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:04.385650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.396815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053db52-cf05-4c14-a564-abc8676c84be admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.401169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.401790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.402181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.402462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.403133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.405033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.416208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.417835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.430932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 792/1577] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:04.430932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.439774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 786/1578] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.439774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.442789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cff11-3747-416d-b393-eea81bca0660 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.489968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:04.514607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320db9-17da-4e23-b6d6-160f93a0c8af admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.515805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.517301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.517823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.518254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.519215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:04.519843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.520517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.520649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.520883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.521343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.522193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.523831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.530098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.538198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 787/1579] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:04.539243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.550466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 793/1580] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:04.553359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f78f0f-98cb-475e-8d79-ef847d322d7b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.558208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.558389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.558885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.559169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.559446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.560650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.562487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.569911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3792351-a125-47ed-8c93-247828853c98 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.575337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.576011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.576299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.576571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.577358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.579067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.592735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 794/1581] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:04.592735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.600618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 788/1582] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.603529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.606349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d7543-030d-4d89-afa8-063e12341a2e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.684484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.685435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.685951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.686386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.687425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c499f95-3fed-4d55-85ba-22bda12850f4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.688796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.692791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.694351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.695033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.695536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.695907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.696775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.698520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.711837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 789/1583] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:04.712951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.719103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 795/1584] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.720001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.728476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c06752-b1b9-47b1-979f-b037c947c683 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.731770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f825a-6001-4068-97f1-29a10aed423d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.734139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.734920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.735307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.735965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.736646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.736936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.737727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.738090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.738501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.739329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.739445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.741081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.755764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 796/1585] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:04.755764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.763851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08f1b-96ae-4c4f-809f-29251af6002d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.771096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 790/1586] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.771096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.772309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.773086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.773374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.773741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.774465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.776608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.785500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f1a4-12a7-4aa4-a641-d3b10dbcdc32 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.793862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.794671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.795054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.795428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.796315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.798635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.816959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 791/1587] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:04.818545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 797/1588] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.819572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.828278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.844974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0b329-67f1-420e-9f05-ed726e9a058c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.849794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:04.901533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea6154-30ac-441e-a4d3-01a8db183e14 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:04.907127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.908024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.908309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.908587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] PATH_INFO: `/v3/projects/7691c75f7a3448e38a99489d3df21925/users/902f574061e64236ae8d6df08093c8e2/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.920105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:04.921089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:04.921550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:04.922001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:04.922698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.924813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.926153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7691c75f7a3448e38a99489d3df21925, user_id=902f574061e64236ae8d6df08093c8e2, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:04.927852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:09:04.927852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:09:04.927852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:09:04.931430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:04.948492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 798/1589] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:04 2022] PUT /identity/v3/projects/7691c75f7a3448e38a99489d3df21925/users/902f574061e64236ae8d6df08093c8e2/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:04.949748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.955508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 792/1590] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:04 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:04.956320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:04.957305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:04.967144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a77b-4fd7-4c05-81b1-c7f2678b5c44 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.023099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d47ff1-008f-43f3-b7de-00aabbe6c9ab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.027828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.028499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.028813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.029098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.029815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.031426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.031974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.033081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.033387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.033814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] PATH_INFO: `/v3/projects/4f87f202405641b2aa2327efc35b6613/users/26cf2c6695084b0894bbfd9d4047f36a/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.045826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 799/1591] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.045826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.050412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f87f202405641b2aa2327efc35b6613, user_id=26cf2c6695084b0894bbfd9d4047f36a, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.053486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.058066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfdc2d-b3ac-4850-b24d-3c94fb6cead7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.063585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.064508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.064831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.065114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.065845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.067621 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.079100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 793/1592] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:04 2022] PUT /identity/v3/projects/4f87f202405641b2aa2327efc35b6613/users/26cf2c6695084b0894bbfd9d4047f36a/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:05.079100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.080420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 800/1593] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.080420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.094440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebeeb-e2b9-4af0-8462-18751dd60c57 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.168707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5b37-6381-40ae-a733-387ea8dc15e5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.174328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c1e2-7ecf-4afd-9b32-dd6a981ad14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.175111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c1e2-7ecf-4afd-9b32-dd6a981ad14b admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.175393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c1e2-7ecf-4afd-9b32-dd6a981ad14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.175854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c1e2-7ecf-4afd-9b32-dd6a981ad14b admin admin] PATH_INFO: `/v3/projects/8c297ec7b46943f594b67c95479f1f7c/users/3f51c03f7fe54451b49ddb32fc337b98/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.188527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.189842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.190480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.190938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.192272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.194440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.196122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c1e2-7ecf-4afd-9b32-dd6a981ad14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c297ec7b46943f594b67c95479f1f7c, user_id=3f51c03f7fe54451b49ddb32fc337b98, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.198956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c1e2-7ecf-4afd-9b32-dd6a981ad14b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.224522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 794/1594] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:05 2022] PUT /identity/v3/projects/8c297ec7b46943f594b67c95479f1f7c/users/3f51c03f7fe54451b49ddb32fc337b98/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:05.224522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571257-1066-43c8-a9fe-efa56716141a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.224522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571257-1066-43c8-a9fe-efa56716141a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.224522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571257-1066-43c8-a9fe-efa56716141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.225079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 801/1595] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:05.225605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.231189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.244662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d15e8-ab0c-4337-be66-1504001e52f3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.251625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-86571257-1066-43c8-a9fe-efa56716141a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:05.253137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-86571257-1066-43c8-a9fe-efa56716141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:05.350683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5d2a9-7926-47e1-bbc3-2692727fe9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.351648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d2a9-7926-47e1-bbc3-2692727fe9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.352120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d2a9-7926-47e1-bbc3-2692727fe9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.352575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d2a9-7926-47e1-bbc3-2692727fe9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.353528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5d2a9-7926-47e1-bbc3-2692727fe9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.355166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5d2a9-7926-47e1-bbc3-2692727fe9f7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.356701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 795/1596] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:05.357738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571257-1066-43c8-a9fe-efa56716141a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.377030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 802/1597] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.378335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526cdbf-d927-42dc-9c5d-402aefc28fcc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.379185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571257-1066-43c8-a9fe-efa56716141a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.379314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526cdbf-d927-42dc-9c5d-402aefc28fcc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.379477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526cdbf-d927-42dc-9c5d-402aefc28fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.384631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.387195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.387538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.387823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.388566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.390264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.401796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 796/1598] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.402623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.412758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb2f71-3d00-47d4-9df5-8bd4b72785d0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.413847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5526cdbf-d927-42dc-9c5d-402aefc28fcc None None] MFA Rules not processed for user `26cf2c6695084b0894bbfd9d4047f36a`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:05.415378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5526cdbf-d927-42dc-9c5d-402aefc28fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:05.418031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb26b30-1673-44c0-83e5-bf48e2788258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.418703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb26b30-1673-44c0-83e5-bf48e2788258 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.418981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb26b30-1673-44c0-83e5-bf48e2788258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.419370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb26b30-1673-44c0-83e5-bf48e2788258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.419487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.419971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb26b30-1673-44c0-83e5-bf48e2788258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.421614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb26b30-1673-44c0-83e5-bf48e2788258 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.432240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 797/1599] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.433562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.433843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.434119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.460605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] MFA Rules not processed for user `83e111e4a0df4636ac9dc837f511e487`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:05.461822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:05.485911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 803/1600] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:05.487202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.487496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.488340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.512937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:05.514245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:05.523039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 804/1601] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:05.523917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.538364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6265b-9ac1-4ded-884e-632c11009107 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.540443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 798/1602] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:05.541377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.551908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.552592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.552956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.553238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.553970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.555624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.566838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 805/1603] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.567878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.577570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323abfd3-f078-4ca7-ae9c-37dbb702af2a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.582321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.583068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.583475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.583758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.584608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.586269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.596319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 806/1604] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.597109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.601260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651076-ea2f-4c93-96d3-bb5e122f173f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.605069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.605722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.606008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.606289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.607436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1824-dbba-4d59-8705-2fe0684beb78 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.612232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1d1b-44f4-401b-bddc-e3b5e346f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.614260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1d1b-44f4-401b-bddc-e3b5e346f7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.614260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1d1b-44f4-401b-bddc-e3b5e346f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.614634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1d1b-44f4-401b-bddc-e3b5e346f7ee admin admin] PATH_INFO: `/v3/projects/5f608b5a2750436eb61009338417d047/users/cdfa0f5687b545f5a820150abe870725/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.616113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.617602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.627002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 799/1605] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:05.627772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.629737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a1d1b-44f4-401b-bddc-e3b5e346f7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f608b5a2750436eb61009338417d047, user_id=cdfa0f5687b545f5a820150abe870725, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.632516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a1d1b-44f4-401b-bddc-e3b5e346f7ee admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.637229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6be86-d660-41e9-9d36-04821029d178 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.642442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719981f-ea14-4408-868e-e639248ee691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.643150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719981f-ea14-4408-868e-e639248ee691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.643431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719981f-ea14-4408-868e-e639248ee691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.643709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719981f-ea14-4408-868e-e639248ee691 admin admin] PATH_INFO: `/v3/projects/6ad0c3cc9eaf41c09d6b967a2fa49900/users/3fb5eecf3e244058905ea3aba8112320/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.659752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 807/1606] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:05 2022] PUT /identity/v3/projects/5f608b5a2750436eb61009338417d047/users/cdfa0f5687b545f5a820150abe870725/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:05.659752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f3388-5835-439f-954b-652864d9fdb7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.659752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f3388-5835-439f-954b-652864d9fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.659752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f3388-5835-439f-954b-652864d9fdb7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.659752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 808/1607] 10.222.0.31 () {54 vars in 961 bytes} [Wed May 25 17:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:05.659752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f3388-5835-439f-954b-652864d9fdb7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.660975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719981f-ea14-4408-868e-e639248ee691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad0c3cc9eaf41c09d6b967a2fa49900, user_id=3fb5eecf3e244058905ea3aba8112320, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.663022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719981f-ea14-4408-868e-e639248ee691 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.665872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.687028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 800/1608] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:05 2022] PUT /identity/v3/projects/6ad0c3cc9eaf41c09d6b967a2fa49900/users/3fb5eecf3e244058905ea3aba8112320/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:05.688795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.689093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.689636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.709289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] MFA Rules not processed for user `83e111e4a0df4636ac9dc837f511e487`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:05.710781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:05.737649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f3388-5835-439f-954b-652864d9fdb7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.776286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 801/1609] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:05.777341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.807888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf9ec-5ad9-476d-ac23-9e7d7bc057ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.808743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf9ec-5ad9-476d-ac23-9e7d7bc057ae service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.809278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf9ec-5ad9-476d-ac23-9e7d7bc057ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.810098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf9ec-5ad9-476d-ac23-9e7d7bc057ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.853084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:05.867174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c9561-c657-4672-a27a-ca3ed56ff155 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.872754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.873515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.873872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.874199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.876077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.878106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.898697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 802/1610] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:05.900696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:05.905030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf9ec-5ad9-476d-ac23-9e7d7bc057ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.906924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf9ec-5ad9-476d-ac23-9e7d7bc057ae service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.915633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e56c9-b5d9-46ac-9b01-014c4d5bebb3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:05.919223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 809/1611] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:05.920558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021895b5-e2ce-4b56-b36b-d9bb385ac8ec None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.920917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021895b5-e2ce-4b56-b36b-d9bb385ac8ec None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.921189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021895b5-e2ce-4b56-b36b-d9bb385ac8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.921913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3405c3-81cd-4a9e-aa09-fe3612be5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:05.923170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3405c3-81cd-4a9e-aa09-fe3612be5bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.923444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3405c3-81cd-4a9e-aa09-fe3612be5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.923933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3405c3-81cd-4a9e-aa09-fe3612be5bd6 admin admin] PATH_INFO: `/v3/projects/53636e313a7e42478677da440f1ab316/users/1e841f91005e441e9c76a0f24bf60025/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:05.940162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-021895b5-e2ce-4b56-b36b-d9bb385ac8ec None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:05.941422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-021895b5-e2ce-4b56-b36b-d9bb385ac8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:05.942789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3405c3-81cd-4a9e-aa09-fe3612be5bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53636e313a7e42478677da440f1ab316, user_id=1e841f91005e441e9c76a0f24bf60025, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:05.945906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3405c3-81cd-4a9e-aa09-fe3612be5bd6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:05.969739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 803/1612] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:05 2022] PUT /identity/v3/projects/53636e313a7e42478677da440f1ab316/users/1e841f91005e441e9c76a0f24bf60025/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:05.971886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b8eb-91a6-44ae-8097-869e4c6646c7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:05.972174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b8eb-91a6-44ae-8097-869e4c6646c7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:05.973037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b8eb-91a6-44ae-8097-869e4c6646c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.001715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cb27b8eb-91a6-44ae-8097-869e4c6646c7 None None] MFA Rules not processed for user `cdfa0f5687b545f5a820150abe870725`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:06.002945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cb27b8eb-91a6-44ae-8097-869e4c6646c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:06.031125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 810/1613] 10.222.0.31 () {58 vars in 1058 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:06.032792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf09dd-8e62-4d0e-b70c-57d9e128c0e2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.033104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf09dd-8e62-4d0e-b70c-57d9e128c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.033381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf09dd-8e62-4d0e-b70c-57d9e128c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.053953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cadf09dd-8e62-4d0e-b70c-57d9e128c0e2 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:06.055353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cadf09dd-8e62-4d0e-b70c-57d9e128c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:06.092745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:06.111382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 804/1614] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:06.114229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72557508-0fce-403b-a18f-488cadafb33c None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.114530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72557508-0fce-403b-a18f-488cadafb33c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.114920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72557508-0fce-403b-a18f-488cadafb33c None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.117487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 805/1615] 10.222.0.31 () {54 vars in 961 bytes} [Wed May 25 17:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:06.118555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72557508-0fce-403b-a18f-488cadafb33c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:06.142892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 811/1616] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:06.144942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.145251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.145530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.179006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] MFA Rules not processed for user `1e841f91005e441e9c76a0f24bf60025`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:06.180721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:06.234833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:06.264550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 812/1617] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:06.268161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:06.268328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72557508-0fce-403b-a18f-488cadafb33c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:06.274963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:06.276357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.276920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.277401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] PATH_INFO: `/v3/projects/197671139e6b42069ba82ea9fdf1da40/users/41618b0540e64de4b968d5cdc39bea0a/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.299495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=197671139e6b42069ba82ea9fdf1da40, user_id=41618b0540e64de4b968d5cdc39bea0a, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:06.302967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:06.327656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 806/1618] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:06 2022] PUT /identity/v3/projects/197671139e6b42069ba82ea9fdf1da40/users/41618b0540e64de4b968d5cdc39bea0a/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:06.328492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:06.427096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11128202-b05b-44eb-992c-bf5e8184ccf8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:06.458033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5865676-d516-4a71-949d-cd0040fd93bc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:06.471170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e746e-b32c-4e74-8c45-fdada2a0019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:06.472016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e746e-b32c-4e74-8c45-fdada2a0019c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.472307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e746e-b32c-4e74-8c45-fdada2a0019c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.474207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e746e-b32c-4e74-8c45-fdada2a0019c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.474917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e746e-b32c-4e74-8c45-fdada2a0019c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:06.476903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e746e-b32c-4e74-8c45-fdada2a0019c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:06.523728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:06.524533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.524857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.525156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.544929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 807/1619] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:06.544929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.544929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.544929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.597749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:06.600403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:06.617806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:06.620600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:06.635158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 813/1620] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:06.636278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:06.662005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:06.736060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:06.747006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cf6f-15bb-4a98-9f16-4ef0b53ae485 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:06.765316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 808/1621] 10.222.0.31 () {58 vars in 1058 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:06.767312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:06.869691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca02d-52c6-446d-ba63-304b261a6e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:06.870511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca02d-52c6-446d-ba63-304b261a6e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.870799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca02d-52c6-446d-ba63-304b261a6e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.871117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca02d-52c6-446d-ba63-304b261a6e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.945004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4faa-d35e-48d9-8f6d-54ab3fbada27 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:06.945228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ca02d-52c6-446d-ba63-304b261a6e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:06.946468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ca02d-52c6-446d-ba63-304b261a6e25 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:06.955491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:06.958130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.959699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 814/1622] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:06.959986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.961549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:06.961845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:06.962215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.962346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:06.963199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:06.965362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:06.982807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:06.984023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:06.996499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 815/1623] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:06.997420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.011475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac71c-b0d0-4126-8f95-d6d08c8dd977 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.019516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.025082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.025082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.025082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.026022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 809/1624] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/projects => generated 371 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:07.027109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.027468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.031052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.077531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 816/1625] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:06 2022] POST /identity/v3/users => generated 291 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:07.078208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.104882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b7d0-5dfa-4683-b7f1-6fa474f11dc5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.123775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a30070-6635-4ca3-b174-4b6e0441d4d7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.131143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c283e56-5dd8-4ef9-87a6-85d504c18bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.131916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283e56-5dd8-4ef9-87a6-85d504c18bea service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.132211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283e56-5dd8-4ef9-87a6-85d504c18bea service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.132626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283e56-5dd8-4ef9-87a6-85d504c18bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.223465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.225095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.225551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.225987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.249808 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:07.265017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c283e56-5dd8-4ef9-87a6-85d504c18bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.266654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c283e56-5dd8-4ef9-87a6-85d504c18bea service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.296708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 810/1626] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:07.298703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be288a9-df76-4891-9818-9cec2573a04b None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.299155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be288a9-df76-4891-9818-9cec2573a04b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.299630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be288a9-df76-4891-9818-9cec2573a04b None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.302564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 811/1627] 10.222.0.31 () {54 vars in 912 bytes} [Wed May 25 17:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:07.303382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be288a9-df76-4891-9818-9cec2573a04b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.336620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:07.386394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.388438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.427333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 817/1628] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:07.429468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.438884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be288a9-df76-4891-9818-9cec2573a04b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.449868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ef66-ada7-4087-b529-11a98145878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.450571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ef66-ada7-4087-b529-11a98145878e admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.450857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ef66-ada7-4087-b529-11a98145878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.451136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ef66-ada7-4087-b529-11a98145878e admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.451838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55ef66-ada7-4087-b529-11a98145878e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.454053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55ef66-ada7-4087-b529-11a98145878e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.473171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68d121-1e55-4ac1-b501-1a257d7c8015 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.490917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.492321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.493534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.493900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.496109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.499692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.527348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 812/1629] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:07 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:07.528828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 818/1630] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:07.530715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.531007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.531292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.534254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.548926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5be6-6212-4a05-bfdc-684619cba1d3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.559759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.561528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.562247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.563258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.564705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.571370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.590986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 819/1631] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:07.592135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.600096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:07.602677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:07.613868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cddabc-8ae3-485c-9eeb-8fbbf1d8042e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.626879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.629740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 813/1632] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:09:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:07.631195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.631486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.632254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.633589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] PATH_INFO: `/v3/projects/0727d6a8a20644218145453e6b6ad070/users/e17bd526ac154bd1a4c16478f85102bd/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.665255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee654f04-1087-497c-8453-ebcd803afa79 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.674277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0727d6a8a20644218145453e6b6ad070, user_id=e17bd526ac154bd1a4c16478f85102bd, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.679891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.680551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.682072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.682282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.682621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] PATH_INFO: `/v3/projects/bd37c017191f4692a88f7bbb0cb4345c/users/a0f8809b5b9d446985281d83ad9f831a/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.714043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd37c017191f4692a88f7bbb0cb4345c, user_id=a0f8809b5b9d446985281d83ad9f831a, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.717995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 820/1633] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:07 2022] PUT /identity/v3/projects/0727d6a8a20644218145453e6b6ad070/users/e17bd526ac154bd1a4c16478f85102bd/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:07.717995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.722050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.757420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 814/1634] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:07 2022] PUT /identity/v3/projects/bd37c017191f4692a88f7bbb0cb4345c/users/a0f8809b5b9d446985281d83ad9f831a/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:07.757420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.817511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a364ef-64d0-441f-8de8-42fbbcb5cf91 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.901201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d7398-81cd-4066-a85b-c180695b5ac4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.904870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.905697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.906124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.906408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.912596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.914271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.915699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.915699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.917758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.922081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:07.950427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 815/1635] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:07.950427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:07.971425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b090df-5120-4f69-a879-20363038b9e7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:07.978065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:07.984368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899701-7cfc-4b6d-acf8-c60ccfd9c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:07.985272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899701-7cfc-4b6d-acf8-c60ccfd9c096 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:07.987699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899701-7cfc-4b6d-acf8-c60ccfd9c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:07.989296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899701-7cfc-4b6d-acf8-c60ccfd9c096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:07.990791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899701-7cfc-4b6d-acf8-c60ccfd9c096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:07.993207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899701-7cfc-4b6d-acf8-c60ccfd9c096 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:08.029191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 816/1636] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:08.033344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06d065-d481-4f13-8095-6eacb7832ee0 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.034634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06d065-d481-4f13-8095-6eacb7832ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.037063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06d065-d481-4f13-8095-6eacb7832ee0 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.041355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 817/1637] 10.222.0.31 () {54 vars in 912 bytes} [Wed May 25 17:09:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:08.043450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06d065-d481-4f13-8095-6eacb7832ee0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:08.068553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:08.070073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:08.089499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06d065-d481-4f13-8095-6eacb7832ee0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:08.094733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c072d-c8b9-483c-aa34-dddbfcfd10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:08.095715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c072d-c8b9-483c-aa34-dddbfcfd10f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.095932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c072d-c8b9-483c-aa34-dddbfcfd10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.096188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c072d-c8b9-483c-aa34-dddbfcfd10f2 admin admin] PATH_INFO: `/v3/projects/0727d6a8a20644218145453e6b6ad070/users/e17bd526ac154bd1a4c16478f85102bd/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.098489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 821/1638] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:08.099715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:08.100829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c072d-c8b9-483c-aa34-dddbfcfd10f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0727d6a8a20644218145453e6b6ad070, user_id=e17bd526ac154bd1a4c16478f85102bd, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:08.103680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c072d-c8b9-483c-aa34-dddbfcfd10f2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:08.127432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 818/1639] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:08 2022] PUT /identity/v3/projects/0727d6a8a20644218145453e6b6ad070/users/e17bd526ac154bd1a4c16478f85102bd/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:08.136259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b2ff9-69c7-4a82-a739-304bb43fed0e service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:08.142028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561eff-3cb6-499b-8058-e9e06ef3cf69 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.142411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561eff-3cb6-499b-8058-e9e06ef3cf69 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.142695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561eff-3cb6-499b-8058-e9e06ef3cf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.197369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8b561eff-3cb6-499b-8058-e9e06ef3cf69 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:08.199989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8b561eff-3cb6-499b-8058-e9e06ef3cf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:08.329811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b4f1e-a29e-4daf-9ed2-6be01f568b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:08.330747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4f1e-a29e-4daf-9ed2-6be01f568b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.331032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4f1e-a29e-4daf-9ed2-6be01f568b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.336333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4f1e-a29e-4daf-9ed2-6be01f568b05 admin admin] PATH_INFO: `/v3/projects/bd37c017191f4692a88f7bbb0cb4345c/users/a0f8809b5b9d446985281d83ad9f831a/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.348738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b4f1e-a29e-4daf-9ed2-6be01f568b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd37c017191f4692a88f7bbb0cb4345c, user_id=a0f8809b5b9d446985281d83ad9f831a, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:08.351631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b4f1e-a29e-4daf-9ed2-6be01f568b05 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:08.364559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:08.389105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 822/1640] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:08 2022] PUT /identity/v3/projects/bd37c017191f4692a88f7bbb0cb4345c/users/a0f8809b5b9d446985281d83ad9f831a/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:08.391080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.391568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.391953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.428579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 819/1641] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:08.431823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.435374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.435875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.464702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] MFA Rules not processed for user `e17bd526ac154bd1a4c16478f85102bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:08.466323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:08.504584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] MFA Rules not processed for user `a0f8809b5b9d446985281d83ad9f831a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:08.508939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:08.625846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 823/1642] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:08.628475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:08.632764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:08.683564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 820/1643] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:08.684746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:08.743797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:08.780497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f930-854f-4eb3-8b8f-c933cfa4a0cc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:08.790801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:08.791483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.791771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.792053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.821710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b077c-1ff0-45f6-a055-4fd90e3ac5e7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:08.834172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:08.835572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.836160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.837086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.860060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:08.867555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:08.891613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 821/1644] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:08.964926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:08.979563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4c51-eec0-464a-b9e6-de7ba669d3f9 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:08.988753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fb875-b72d-40aa-80fa-f0ee70f85ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:08.989621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fb875-b72d-40aa-80fa-f0ee70f85ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:08.989913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fb875-b72d-40aa-80fa-f0ee70f85ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:08.990196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fb875-b72d-40aa-80fa-f0ee70f85ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:08.993830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:08.998548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:09.017866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fb875-b72d-40aa-80fa-f0ee70f85ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:09.024890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fb875-b72d-40aa-80fa-f0ee70f85ea2 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:09.043723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 824/1645] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:09.052014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 822/1646] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:09:09.420052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:09.444837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde41953-e5e4-4c5f-9e64-fec4f703aadf service glance] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:09.466926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0957d3-63c3-492e-8eb8-6bf0653aca55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:09.467622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0957d3-63c3-492e-8eb8-6bf0653aca55 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:09.467913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0957d3-63c3-492e-8eb8-6bf0653aca55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:09.468204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0957d3-63c3-492e-8eb8-6bf0653aca55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:09.693635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0957d3-63c3-492e-8eb8-6bf0653aca55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:09.695122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0957d3-63c3-492e-8eb8-6bf0653aca55 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:09.716179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 825/1647] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:10.616858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeed90-f368-44bc-bb0c-9cc165c44040 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:10.617777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeed90-f368-44bc-bb0c-9cc165c44040 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:10.618524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeed90-f368-44bc-bb0c-9cc165c44040 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:10.621881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 823/1648] 10.222.0.31 () {54 vars in 912 bytes} [Wed May 25 17:09:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:10.627686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40f79-1d0b-4227-98de-8067b212ffdf None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:10.628226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40f79-1d0b-4227-98de-8067b212ffdf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:10.628344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40f79-1d0b-4227-98de-8067b212ffdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:10.749396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e7b40f79-1d0b-4227-98de-8067b212ffdf None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:10.750901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7b40f79-1d0b-4227-98de-8067b212ffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:10.932798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 826/1649] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:11.013254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeed90-f368-44bc-bb0c-9cc165c44040 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:11.032931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeed90-f368-44bc-bb0c-9cc165c44040 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:11.052149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0b82d-6741-4cbb-910c-6d3aabac625e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:11.052852 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0b82d-6741-4cbb-910c-6d3aabac625e service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:11.053139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0b82d-6741-4cbb-910c-6d3aabac625e service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:11.053416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0b82d-6741-4cbb-910c-6d3aabac625e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:11.073859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0b82d-6741-4cbb-910c-6d3aabac625e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:11.075456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0b82d-6741-4cbb-910c-6d3aabac625e service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:11.097001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 824/1650] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:12.852889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36608-7b28-49dd-9fc3-c8f771e63d37 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:12.853407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36608-7b28-49dd-9fc3-c8f771e63d37 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:12.853667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36608-7b28-49dd-9fc3-c8f771e63d37 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:12.855199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 827/1651] 10.222.0.31 () {54 vars in 960 bytes} [Wed May 25 17:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:12.862088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:12.862600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:12.862667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:12.919181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:12.920411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:13.072219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:13.082121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36608-7b28-49dd-9fc3-c8f771e63d37 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:13.110392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:13.153940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 825/1652] 10.222.0.31 () {58 vars in 1057 bytes} [Wed May 25 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:13.162437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:13.185325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8a151-a948-4e4b-ab28-b9ff426b16fc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:13.200132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:13.201010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:13.201545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:13.201964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:13.205687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:13.232359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:13.238609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92ad7f-f3ca-4cc5-9881-b52408a062af service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:13.251483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36608-7b28-49dd-9fc3-c8f771e63d37 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:13.264004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 826/1653] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:13.264667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:13.265607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:13.265898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:13.266179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] PATH_INFO: `/v3/users/cdfa0f5687b545f5a820150abe870725` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:13.267592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfa0f5687b545f5a820150abe870725)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:13.268875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: WARNING py.warnings [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:09:13.268875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: warnings.warn(msg) May 25 17:09:13.268875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: May 25 17:09:13.270157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:13.450781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfa0f5687b545f5a820150abe870725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:13.462175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfa0f5687b545f5a820150abe870725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:13.463081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfa0f5687b545f5a820150abe870725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:13.515902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfa0f5687b545f5a820150abe870725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:13.544936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfa0f5687b545f5a820150abe870725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:13.567201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 828/1654] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:13 2022] DELETE /identity/v3/users/cdfa0f5687b545f5a820150abe870725 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:13.575489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:13.576567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:13.577337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:13.605896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:13.607430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:13.757091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 827/1655] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:13.769948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:13.771528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:13.902514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc69f-ed0c-49de-8435-da6c26658407 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:13.906915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:13.907659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:13.908069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:13.908440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:13.937901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:13.940574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:13.955441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 829/1656] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:15.408586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:15.411425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:15.432449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25ccc-5796-4063-af20-79fca8bfd6e9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:15.447357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:15.448494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:15.449048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:15.449725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] PATH_INFO: `/v3/projects/5f608b5a2750436eb61009338417d047` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:15.456836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f608b5a2750436eb61009338417d047)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:15.458047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: WARNING py.warnings [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 17:09:15.458047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: warnings.warn(msg) May 25 17:09:15.458047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: May 25 17:09:15.473361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:15.607862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f608b5a2750436eb61009338417d047', 'request_id': 'req-a2001b28-9734-47be-b593-4c2022fc28b6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.630518 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f608b5a2750436eb61009338417d047', 'request_id': 'req-a2001b28-9734-47be-b593-4c2022fc28b6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.661704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f608b5a2750436eb61009338417d047', 'request_id': 'req-a2001b28-9734-47be-b593-4c2022fc28b6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.686547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] The token cache is being invalidate because project 5f608b5a2750436eb61009338417d047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:15.686547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.687583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a2001b28-9734-47be-b593-4c2022fc28b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.693299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:15.693850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 828/1657] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:15 2022] DELETE /identity/v3/projects/5f608b5a2750436eb61009338417d047 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:15.707243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40395d-bd3d-4583-ae29-ab17789f818a service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:15.777966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:15.826067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:15.827340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:15.827885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:15.828789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] PATH_INFO: `/v3/users/e17bd526ac154bd1a4c16478f85102bd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:15.832146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17bd526ac154bd1a4c16478f85102bd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:15.836431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:15.905316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17bd526ac154bd1a4c16478f85102bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.915676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17bd526ac154bd1a4c16478f85102bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.916855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17bd526ac154bd1a4c16478f85102bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.950532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17bd526ac154bd1a4c16478f85102bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:15.978266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17bd526ac154bd1a4c16478f85102bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:16.000856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 830/1658] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:15 2022] DELETE /identity/v3/users/e17bd526ac154bd1a4c16478f85102bd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:16.662467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:16.662983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:16.663060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:16.743187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] MFA Rules not processed for user `902f574061e64236ae8d6df08093c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:16.744424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:16.842208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:16.932982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 829/1659] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:16.950420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:16.953110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:17.068551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:17.070012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:17.196662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4629-a424-43bf-b59d-105e3208c048 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:17.208371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ea85-2fc7-4475-af20-b9d47966dfae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:17.211896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ea85-2fc7-4475-af20-b9d47966dfae service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:17.212189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ea85-2fc7-4475-af20-b9d47966dfae service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:17.212465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ea85-2fc7-4475-af20-b9d47966dfae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:17.225784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e43cc-8c66-4142-bb94-696701785167 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:17.232745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ea85-2fc7-4475-af20-b9d47966dfae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:17.242660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ea85-2fc7-4475-af20-b9d47966dfae service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:17.244453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:17.245773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:17.245773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:17.246065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] PATH_INFO: `/v3/projects/0727d6a8a20644218145453e6b6ad070` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:17.247343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0727d6a8a20644218145453e6b6ad070)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:17.252635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:17.262798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 831/1660] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:17.405314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0727d6a8a20644218145453e6b6ad070', 'request_id': 'req-22084d9a-1f54-4ba4-90f7-5de228e1c058'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:17.423095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0727d6a8a20644218145453e6b6ad070', 'request_id': 'req-22084d9a-1f54-4ba4-90f7-5de228e1c058'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:17.431605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0727d6a8a20644218145453e6b6ad070', 'request_id': 'req-22084d9a-1f54-4ba4-90f7-5de228e1c058'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:17.461782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] The token cache is being invalidate because project 0727d6a8a20644218145453e6b6ad070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:17.462079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:17.462917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22084d9a-1f54-4ba4-90f7-5de228e1c058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:17.470093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 830/1661] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:17 2022] DELETE /identity/v3/projects/0727d6a8a20644218145453e6b6ad070 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:17.471667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:17.472496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:17.472816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:17.519960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:17.522872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:17.630792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:17.711209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 832/1662] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:17.713322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:17.714739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:17.714739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:17.763595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:17.765445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:17.783135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 831/1663] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:17.787954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:17.799904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38d17-b4ce-4c82-a76a-45e521c145df None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:17.831028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:17.833523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:17.833982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:17.834410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:17.835310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:17.836800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:17.838684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:17.876215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 833/1664] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:17.880700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:17.896560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176e7d-1bf5-48af-af19-28f612278662 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:17.908145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:17.908889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:17.909180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:17.909529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:17.910754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:17.912957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:18.007771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 832/1665] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:17 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:18.012044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:18.033902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6555-fa08-41c4-bcea-d9e7fdd1ac7d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:18.192311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:18.192491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:18.192807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:18.193086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:18.193794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:18.195814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:18.239536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:18.253097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 834/1666] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:18 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:18.269503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74269ccb-fd0c-4275-bddc-e567e6e7ade5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:18.289485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:18.290423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:18.290881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:18.291298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:18.294663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:18.301315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:18.338189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 833/1667] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:18.342488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:18.357730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2436-7221-419b-b0fb-cfe6ba014812 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:18.372635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0c9ec-6b85-4aff-8e7d-cece943e89cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:18.373552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0c9ec-6b85-4aff-8e7d-cece943e89cd admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:18.373996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0c9ec-6b85-4aff-8e7d-cece943e89cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:18.374420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0c9ec-6b85-4aff-8e7d-cece943e89cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:18.375324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0c9ec-6b85-4aff-8e7d-cece943e89cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:18.378118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0c9ec-6b85-4aff-8e7d-cece943e89cd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:18.406829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 835/1668] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:18.410389 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:18.428561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33506-0a15-4a79-a92d-b6320a454a06 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:18.437384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:18.438561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:18.438997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:18.439693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] PATH_INFO: `/v3/projects/853bdf2ad18a44e79889702666782681/users/3e0e5a2cc4c04f43a73c96ee87af28a7/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:18.475295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] RBAC: Authorizing `identity:create_grant(project_id=853bdf2ad18a44e79889702666782681, user_id=3e0e5a2cc4c04f43a73c96ee87af28a7, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:18.478301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:18.506493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 834/1669] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:18 2022] PUT /identity/v3/projects/853bdf2ad18a44e79889702666782681/users/3e0e5a2cc4c04f43a73c96ee87af28a7/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:18.516695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bd9cb-ad53-40d3-9483-7acdfd31a8c8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:18.517216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bd9cb-ad53-40d3-9483-7acdfd31a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:18.517661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bd9cb-ad53-40d3-9483-7acdfd31a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:18.577347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7c9bd9cb-ad53-40d3-9483-7acdfd31a8c8 None None] MFA Rules not processed for user `3e0e5a2cc4c04f43a73c96ee87af28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:18.578899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7c9bd9cb-ad53-40d3-9483-7acdfd31a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:19.003349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 836/1670] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:19.007588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:19.014186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:19.172732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb47f-c7c4-4c62-a4b5-e0bc3881019f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:19.176991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.177414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.177631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.187415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:19.188247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.188789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.189544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.190466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:19.193271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:19.230531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:19.235722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:19.260095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 835/1671] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:19 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:19.261388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:19.346731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:19.446989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 837/1672] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:19.463361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69618-f9ef-482f-ba7f-4b44ed72c519 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:19.478250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:19.479307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.479771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.480226 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.483082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:19.489096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:19.545013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 836/1673] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:19 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:19.548754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:19.582602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048dde1-a6a3-480b-80a0-5c4418c44998 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:19.592520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:19.593450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.593807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.594215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.594929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:19.604528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:19.649432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:19.650419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 838/1674] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:19.664459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf14c2-ab81-4113-8842-99aac396bf10 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:19.704566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:19.705586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.706555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.706555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.707517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:19.709555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:19.728554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 837/1675] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:19.732543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:19.733938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:19.740289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:19.754248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804556d-d9b8-4e17-adfb-b1fa0f06be19 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:19.772069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433dd6-4e45-4f1e-83bb-93bd28166c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:19.773295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433dd6-4e45-4f1e-83bb-93bd28166c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.775313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433dd6-4e45-4f1e-83bb-93bd28166c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.775734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433dd6-4e45-4f1e-83bb-93bd28166c7f admin admin] PATH_INFO: `/v3/projects/95a7979c0f7847e9970344959d804250/users/10e4e482bfec4b6383c01ae785f17ce4/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.813959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433dd6-4e45-4f1e-83bb-93bd28166c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a7979c0f7847e9970344959d804250, user_id=10e4e482bfec4b6383c01ae785f17ce4, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:19.817648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433dd6-4e45-4f1e-83bb-93bd28166c7f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:19.844439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 839/1676] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:19 2022] PUT /identity/v3/projects/95a7979c0f7847e9970344959d804250/users/10e4e482bfec4b6383c01ae785f17ce4/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:19.855901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:19.856477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:19.856947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:19.875037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d181e-a480-4be9-9a58-c44adf7af757 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:19.898466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:19.912007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] MFA Rules not processed for user `10e4e482bfec4b6383c01ae785f17ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:19.913367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:20.109125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:20.110315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:20.110653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:20.110936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:20.139842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 840/1677] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:20.143107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:20.259239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600313f-e2f1-4af9-add9-233d748ee117 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:20.272137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:20.272671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:20.276822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:20.277169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:20.277918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:20.279876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:20.342683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 841/1678] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:20.352114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:20.352372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:20.355908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:20.383887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 838/1679] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:09:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:09:20.442699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:20.640973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb4e6-c0d9-4874-8086-a63fb8c3d399 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:20.649299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:20.650916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:20.674980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:20.676920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:20.677348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:20.677756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:20.678612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:20.681818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:20.735107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697bd23-a3a4-46ac-bae6-3f7edcfcdf7c service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:20.763237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:20.765206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 842/1680] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:20 2022] POST /identity/v3/users => generated 300 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:20.772354 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:20.772793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:20.774282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:20.778203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] PATH_INFO: `/v3/users/26cf2c6695084b0894bbfd9d4047f36a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:20.783562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cf2c6695084b0894bbfd9d4047f36a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:20.786972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:20.835668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e8a53-69a6-48b8-b3f8-5c3dc2d59b61 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:20.862470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:20.863408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:20.863701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:20.863983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:20.864754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:20.883025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:20.930595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 843/1681] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:20.935509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:20.989440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda76108-5e9b-4356-8fb0-f1b718c01e9b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:21.009450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:21.010384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:21.010676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:21.010964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] PATH_INFO: `/v3/projects/cba07b4637e44ba9a5d6b7a1218d73c4/users/55fae92b808c48d48cb0d55ff4266a66/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:21.080440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cf2c6695084b0894bbfd9d4047f36a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:21.085256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cf2c6695084b0894bbfd9d4047f36a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:21.087054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cf2c6695084b0894bbfd9d4047f36a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:21.098332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba07b4637e44ba9a5d6b7a1218d73c4, user_id=55fae92b808c48d48cb0d55ff4266a66, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:21.101880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:21.158322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cf2c6695084b0894bbfd9d4047f36a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:21.185808 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 844/1682] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:20 2022] PUT /identity/v3/projects/cba07b4637e44ba9a5d6b7a1218d73c4/users/55fae92b808c48d48cb0d55ff4266a66/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:21.190696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:21.194978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:21.197940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2b3f1f90-bed2-4f3b-89db-055c74238c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cf2c6695084b0894bbfd9d4047f36a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:21.256752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 839/1683] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:20 2022] DELETE /identity/v3/users/26cf2c6695084b0894bbfd9d4047f36a => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:21.262552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:21.262911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:21.263202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:21.342147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:21.349531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:21.439021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:21.543894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799266d-b7d6-4427-af7d-5329ebb543a1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:21.641636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 840/1684] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:21.732627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:21.734708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:21.884647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:21.885438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:21.885724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:21.886007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:21.886749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:21.888412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:21.936208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 845/1685] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 746 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:21.940380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:21.978776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618db01-ccc8-45df-b38f-89b0c23a0ca3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:21.985408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83135a76-21d2-48d2-a0fd-dd90bb97546f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:21.991711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4979fe1-ff8c-44b1-b997-b2397e738cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:21.992691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4979fe1-ff8c-44b1-b997-b2397e738cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:21.992954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4979fe1-ff8c-44b1-b997-b2397e738cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:21.994915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:21.997495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:21.997840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:21.998129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:21.999157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4979fe1-ff8c-44b1-b997-b2397e738cda admin admin] PATH_INFO: `/v3/projects/cba07b4637e44ba9a5d6b7a1218d73c4/users/55fae92b808c48d48cb0d55ff4266a66/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:22.005830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4979fe1-ff8c-44b1-b997-b2397e738cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba07b4637e44ba9a5d6b7a1218d73c4, user_id=55fae92b808c48d48cb0d55ff4266a66, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:22.011895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4979fe1-ff8c-44b1-b997-b2397e738cda admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:22.023539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:22.035362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:22.074900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 846/1686] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:21 2022] PUT /identity/v3/projects/cba07b4637e44ba9a5d6b7a1218d73c4/users/55fae92b808c48d48cb0d55ff4266a66/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:22.086086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:22.086382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:22.086659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:22.094957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 841/1687] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:22.119164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:22.194099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] MFA Rules not processed for user `55fae92b808c48d48cb0d55ff4266a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:22.206217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:22.417806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 847/1688] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:22.427255 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:22.428939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:22.570993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2dd2d-9554-4908-9d3c-13450f0482db service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:22.852455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6487ad-c646-4834-aa9a-923c43241aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:22.853192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6487ad-c646-4834-aa9a-923c43241aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:22.853489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6487ad-c646-4834-aa9a-923c43241aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:22.853769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6487ad-c646-4834-aa9a-923c43241aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:22.897951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6487ad-c646-4834-aa9a-923c43241aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:22.900267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6487ad-c646-4834-aa9a-923c43241aa5 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:22.938439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 842/1689] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:24.556005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:24.559692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:24.611950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd62d-96c3-4d2d-85f8-9eb4596048f1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:24.647956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:24.651822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:24.652568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:24.654630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:24.664027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:24.797700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:24.801146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:24.801724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:24.938959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] MFA Rules not processed for user `41618b0540e64de4b968d5cdc39bea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:24.945476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:24.946407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:24.957897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:24.994782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 848/1690] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:24.995710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:25.005270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:25.008349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:25.173248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 843/1691] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:25.188734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:25.191459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:25.272357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6554739-7448-4b9d-a523-66b6eaaeb6db service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:25.289334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:25.295671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:25.295973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:25.296250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] PATH_INFO: `/v3/projects/4f87f202405641b2aa2327efc35b6613` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:25.307863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f87f202405641b2aa2327efc35b6613)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:25.317402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:25.464012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:25.542102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f87f202405641b2aa2327efc35b6613', 'request_id': 'req-d7988dd3-1715-41a0-88cd-1f9db88143bf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:25.574784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f87f202405641b2aa2327efc35b6613', 'request_id': 'req-d7988dd3-1715-41a0-88cd-1f9db88143bf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:25.578867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f5231-5c87-446b-9636-54f63feee102 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:25.601747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f87f202405641b2aa2327efc35b6613', 'request_id': 'req-d7988dd3-1715-41a0-88cd-1f9db88143bf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:25.645440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] The token cache is being invalidate because project 4f87f202405641b2aa2327efc35b6613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:25.645753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:25.650814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7988dd3-1715-41a0-88cd-1f9db88143bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:25.654089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 849/1692] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:24 2022] DELETE /identity/v3/projects/4f87f202405641b2aa2327efc35b6613 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:25.666010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d76c6-6d11-44f7-abe9-fb8198a7ab08 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:25.669511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d76c6-6d11-44f7-abe9-fb8198a7ab08 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:25.670516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d76c6-6d11-44f7-abe9-fb8198a7ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:25.772400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-696d76c6-6d11-44f7-abe9-fb8198a7ab08 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:25.785995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-696d76c6-6d11-44f7-abe9-fb8198a7ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:25.881390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:25.883274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:25.883883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:25.884313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:25.900249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:26.036105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 850/1693] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:26.044172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.044378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.045273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.097890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:26.102125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:26.108866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:26.129843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 851/1694] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:26.131129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:26.153065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e70fc-aa47-4c09-89bc-a2bea64bfe41 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:26.159102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:26.161068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:26.161610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:26.162701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.163212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.163690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.164630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:26.165385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:26.167572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:26.186827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 852/1695] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:26.194666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:26.217848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0006b5-a1a4-47c9-ab89-e2712ac4aa7c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:26.218940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 844/1696] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1031 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:26.233843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:26.234897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.235396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.235907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.237054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:26.239972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:26.282462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 853/1697] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:26 2022] POST /identity/v3/projects => generated 403 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:26.287251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:26.310804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c386e-6fad-449b-b74c-dba097d1000c service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:26.537098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:26.537829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.538113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.538386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.539090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:26.541104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:26.598152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 845/1698] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:26 2022] POST /identity/v3/users => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:26.600901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:26.615314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ead4a-24b1-4c93-a25b-d827e6d1dfe5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:26.637539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9828-2284-4f60-b8b1-d190eed646a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:26.638502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9828-2284-4f60-b8b1-d190eed646a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.639024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9828-2284-4f60-b8b1-d190eed646a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.639455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9828-2284-4f60-b8b1-d190eed646a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.640740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9828-2284-4f60-b8b1-d190eed646a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:26.642791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9828-2284-4f60-b8b1-d190eed646a2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:26.697091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 854/1699] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:26.697290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:26.706839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.707159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.707442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.715979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d7ee-0123-41e9-88fb-bfd7059d15d3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:26.730846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96445002-81a7-4e4e-97cc-85bcce52d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:26.731540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445002-81a7-4e4e-97cc-85bcce52d59a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.742399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445002-81a7-4e4e-97cc-85bcce52d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.742746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445002-81a7-4e4e-97cc-85bcce52d59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.743620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96445002-81a7-4e4e-97cc-85bcce52d59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:26.752074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96445002-81a7-4e4e-97cc-85bcce52d59a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:26.789814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 846/1700] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:26.791260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabfd7d-4956-4ea5-8071-58c5420eec49 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:26.795882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabfd7d-4956-4ea5-8071-58c5420eec49 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:26.796224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabfd7d-4956-4ea5-8071-58c5420eec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:26.819386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] MFA Rules not processed for user `3f51c03f7fe54451b49ddb32fc337b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:26.820943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:26.868941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5dabfd7d-4956-4ea5-8071-58c5420eec49 None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:26.886773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5dabfd7d-4956-4ea5-8071-58c5420eec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:27.016120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:27.041134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 855/1701] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:27.042014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:27.043476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 847/1702] 10.222.0.71 () {58 vars in 1015 bytes} [Wed May 25 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:27.056982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac363a1d-71d5-468e-b0e2-8a1cda2d5eb3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:27.057382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac363a1d-71d5-468e-b0e2-8a1cda2d5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:27.057666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac363a1d-71d5-468e-b0e2-8a1cda2d5eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:27.081488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f9be-e3de-4f21-85a5-506893a14bb9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:27.092388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:27.093909 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:27.094446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:27.094946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] PATH_INFO: `/v3/projects/56312fad2ba54c13b10e35801fe26db8/users/ab27fe98213d4a61bed03ff8760a2007/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:27.124511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56312fad2ba54c13b10e35801fe26db8, user_id=ab27fe98213d4a61bed03ff8760a2007, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:27.128995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:27.141154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ac363a1d-71d5-468e-b0e2-8a1cda2d5eb3 None None] MFA Rules not processed for user `3f51c03f7fe54451b49ddb32fc337b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:27.141527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ac363a1d-71d5-468e-b0e2-8a1cda2d5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:27.169214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 856/1703] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:27 2022] PUT /identity/v3/projects/56312fad2ba54c13b10e35801fe26db8/users/ab27fe98213d4a61bed03ff8760a2007/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:27.169415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 848/1704] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:27.200564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:27.200564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:27.200564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:27.208595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:27.215347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:27.318372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] MFA Rules not processed for user `ab27fe98213d4a61bed03ff8760a2007`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:27.323719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:27.534205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc15198-d9c3-48ff-ae73-202f782b6b62 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:27.559972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:27.560650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:27.560938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:27.561263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:27.568596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 849/1705] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:27.569573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:27.582145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:27.592841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:27.725829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:27.727461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:27.735666 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa6160-2f9f-4017-af0c-1f82c9fa4d82 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:27.747964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:27.748654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:27.749041 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:27.749333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:27.769355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 857/1706] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:27.770474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:27.777770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:27.779271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:27.812159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 850/1707] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:27.941618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb08761-a9fe-4ec1-98aa-41ce0ad632f9 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:27.966636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:27.967371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:27.967655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:27.967931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:27.972185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:27.981978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:28.038925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:28.091145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 858/1708] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:27 2022] POST /identity/v3/projects => generated 405 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:28.095166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:28.121265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144392c-6ec9-4963-9262-3354a1a74b05 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:28.267067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:28.268135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:28.269252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:28.269630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:28.270904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:28.273617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:28.330647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 851/1709] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:28 2022] POST /identity/v3/users => generated 309 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:28.334307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:28.358301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a72317-8343-4f56-be2b-677591de689f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:28.382771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22cbb7-d5eb-409a-ada0-e81e5a40ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:28.383546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22cbb7-d5eb-409a-ada0-e81e5a40ba54 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:28.383761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22cbb7-d5eb-409a-ada0-e81e5a40ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:28.384050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22cbb7-d5eb-409a-ada0-e81e5a40ba54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:28.385006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22cbb7-d5eb-409a-ada0-e81e5a40ba54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:28.391922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22cbb7-d5eb-409a-ada0-e81e5a40ba54 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:28.449121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 859/1710] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:28.456553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:28.478175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a409c-8d7e-494f-9528-b4e4c1aefa01 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:28.489266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:28.490541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:28.491143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:28.491615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] PATH_INFO: `/v3/projects/0d85f701624c4376bed42ecccb599066/users/59719f5b4ccb48c6894798170b09618d/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:28.516278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f085-c7de-4551-b40a-83d4eb993ffe None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:28.517455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f085-c7de-4551-b40a-83d4eb993ffe None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:28.518279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f085-c7de-4551-b40a-83d4eb993ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:28.575236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d85f701624c4376bed42ecccb599066, user_id=59719f5b4ccb48c6894798170b09618d, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:28.594517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:28.631790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8731f085-c7de-4551-b40a-83d4eb993ffe None None] MFA Rules not processed for user `902f574061e64236ae8d6df08093c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:28.655556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8731f085-c7de-4551-b40a-83d4eb993ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:28.695163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 852/1711] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:28 2022] PUT /identity/v3/projects/0d85f701624c4376bed42ecccb599066/users/59719f5b4ccb48c6894798170b09618d/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:28.699476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:28.865767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e0b69-c62a-4be1-a4ba-e0bdc241401e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:28.876671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:28.878305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:28.878803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:28.879294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:28.880250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:28.886857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:28.919431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 860/1712] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:28.920481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 853/1713] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:28.921738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:28.946047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73af4c-da96-499a-96dc-e6ee7bf6e053 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:28.963651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:28.964767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:28.965144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:28.965484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] PATH_INFO: `/v3/projects/0d85f701624c4376bed42ecccb599066/users/59719f5b4ccb48c6894798170b09618d/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:28.969862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d85f701624c4376bed42ecccb599066, user_id=59719f5b4ccb48c6894798170b09618d, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:28.989796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:29.005388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:29.034650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 854/1714] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:28 2022] PUT /identity/v3/projects/0d85f701624c4376bed42ecccb599066/users/59719f5b4ccb48c6894798170b09618d/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:29.044954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:29.045499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:29.046035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:29.114535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] MFA Rules not processed for user `59719f5b4ccb48c6894798170b09618d`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:29.118044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:29.360053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 861/1715] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:29.429931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:29.431897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:29.600631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d5a1b-1e0e-4f1d-a0fd-b1db5996c02c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:29.605544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c102e-0983-4662-8b0e-41c174d11d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:29.606277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c102e-0983-4662-8b0e-41c174d11d28 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:29.606558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c102e-0983-4662-8b0e-41c174d11d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:29.607032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c102e-0983-4662-8b0e-41c174d11d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:29.623259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c102e-0983-4662-8b0e-41c174d11d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:29.624929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c102e-0983-4662-8b0e-41c174d11d28 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:29.644129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 855/1716] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:30.260556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:30.453350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ff328-777e-470a-bf2b-70aeb16fa337 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:30.461751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:30.462805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:30.463178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:30.463543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] PATH_INFO: `/v3/users/ab27fe98213d4a61bed03ff8760a2007` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:30.477474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab27fe98213d4a61bed03ff8760a2007)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:30.483703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:30.523926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:30.633734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab27fe98213d4a61bed03ff8760a2007'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:30.667636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab27fe98213d4a61bed03ff8760a2007'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:30.669665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab27fe98213d4a61bed03ff8760a2007'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:30.743791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab27fe98213d4a61bed03ff8760a2007'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:30.774382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab27fe98213d4a61bed03ff8760a2007'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:30.819376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 862/1717] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:30 2022] DELETE /identity/v3/users/ab27fe98213d4a61bed03ff8760a2007 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:30.823961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd5b8c-b711-46fe-ad45-bc18c9454986 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:30.825545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd5b8c-b711-46fe-ad45-bc18c9454986 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:30.826084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd5b8c-b711-46fe-ad45-bc18c9454986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:30.866988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-52bd5b8c-b711-46fe-ad45-bc18c9454986 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:30.868246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-52bd5b8c-b711-46fe-ad45-bc18c9454986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:31.079439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:31.083881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:31.108080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 856/1718] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:31.264882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ad543-5563-462a-9b5d-7422740a4783 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:31.278587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:31.283139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:31.283655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:31.285071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:31.287972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:31.288831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce038-0bfe-4804-a487-1d8bcf3a85a4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:31.289459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce038-0bfe-4804-a487-1d8bcf3a85a4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:31.289459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce038-0bfe-4804-a487-1d8bcf3a85a4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:31.290889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 857/1719] 10.222.0.31 () {54 vars in 912 bytes} [Wed May 25 17:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:09:31.311328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:31.311663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:31.311883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:31.378699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:31.380073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:31.534922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:31.542377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:31.587637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 863/1720] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:09:31.591868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:31.598974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:31.643341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 858/1721] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:09:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:31.687830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:31.693473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:31.720318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeec4e-b4f6-450f-9611-5daf27c972bb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:31.743942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fce1fa-ac90-4eb6-b914-9920a9ab3b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:31.744706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fce1fa-ac90-4eb6-b914-9920a9ab3b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:31.744997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fce1fa-ac90-4eb6-b914-9920a9ab3b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:31.745270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fce1fa-ac90-4eb6-b914-9920a9ab3b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:31.767472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fce1fa-ac90-4eb6-b914-9920a9ab3b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:31.769228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fce1fa-ac90-4eb6-b914-9920a9ab3b53 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:31.796704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 859/1722] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:09:31.939969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:31.968388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6212f11-8af6-43d6-8098-649349c61c6a service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:31.993543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd4f40-d112-47b9-ac15-9b745ffcf722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:31.994247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4f40-d112-47b9-ac15-9b745ffcf722 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:31.994542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4f40-d112-47b9-ac15-9b745ffcf722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:31.994829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4f40-d112-47b9-ac15-9b745ffcf722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:32.027917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd4f40-d112-47b9-ac15-9b745ffcf722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:32.029468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd4f40-d112-47b9-ac15-9b745ffcf722 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:32.080436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 864/1723] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:32.681923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2c33-7bd0-47ce-9fb2-fe4fefbe1c5e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:32.682870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2c33-7bd0-47ce-9fb2-fe4fefbe1c5e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:32.683158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2c33-7bd0-47ce-9fb2-fe4fefbe1c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:32.756537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-124f2c33-7bd0-47ce-9fb2-fe4fefbe1c5e None None] MFA Rules not processed for user `3fb5eecf3e244058905ea3aba8112320`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:32.758904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-124f2c33-7bd0-47ce-9fb2-fe4fefbe1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:32.827651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:33.024820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 860/1724] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:33.052635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f25f-eefa-4cbf-837e-aa603528c908 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:33.053556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f25f-eefa-4cbf-837e-aa603528c908 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:33.053983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f25f-eefa-4cbf-837e-aa603528c908 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:33.055533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 865/1725] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:33.102888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c028-b900-4267-8dcd-1bda6c59ba08 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:33.103451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c028-b900-4267-8dcd-1bda6c59ba08 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:33.103886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c028-b900-4267-8dcd-1bda6c59ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:33.177752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c860c028-b900-4267-8dcd-1bda6c59ba08 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:33.179024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c860c028-b900-4267-8dcd-1bda6c59ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:33.480414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 861/1726] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:34.020031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f25f-eefa-4cbf-837e-aa603528c908 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:34.024485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6775f25f-eefa-4cbf-837e-aa603528c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:34.030903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f6be-5b71-4549-b958-1c2bd71b673a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:34.031376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f6be-5b71-4549-b958-1c2bd71b673a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:34.031454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f6be-5b71-4549-b958-1c2bd71b673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:34.093096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f25f-eefa-4cbf-837e-aa603528c908 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:34.094774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ea15f6be-5b71-4549-b958-1c2bd71b673a None None] MFA Rules not processed for user `3f51c03f7fe54451b49ddb32fc337b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:34.096057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ea15f6be-5b71-4549-b958-1c2bd71b673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:34.129510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:34.130202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:34.132405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:34.132734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:34.173498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:34.178628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:34.229426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 866/1727] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:34.380500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 862/1728] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:34.526062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:34.544989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273947c-e31b-428d-ad9a-8bb65c931c31 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:34.587438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:34.589907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:34.601200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:34.601904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:34.633176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:34.638483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:34.738195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 867/1729] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:34.921068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:34.922207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:34.922207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:34.996804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] MFA Rules not processed for user `41618b0540e64de4b968d5cdc39bea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:34.998316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:35.253843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 863/1730] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:35.322717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:35.324561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:35.359771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf499-6921-4c80-b509-d6003cc3a4cc service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:35.383308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:35.384213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:35.384491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:35.384980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] PATH_INFO: `/v3/projects/56312fad2ba54c13b10e35801fe26db8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:35.386812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56312fad2ba54c13b10e35801fe26db8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:35.388962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:35.575346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56312fad2ba54c13b10e35801fe26db8', 'request_id': 'req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:35.595062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56312fad2ba54c13b10e35801fe26db8', 'request_id': 'req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:35.606778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56312fad2ba54c13b10e35801fe26db8', 'request_id': 'req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:35.618313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:35.620085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:35.637120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:35.655541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] The token cache is being invalidate because project 56312fad2ba54c13b10e35801fe26db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:35.655951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b62c0-bea9-4e62-8814-557790fd8a32 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:35.658975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:35.661338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:35.670538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 868/1731] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:35 2022] DELETE /identity/v3/projects/56312fad2ba54c13b10e35801fe26db8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:35.686284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:35.692811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:35.898476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:35.902413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:35.902822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:35.903210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] PATH_INFO: `/v3/users/3e0e5a2cc4c04f43a73c96ee87af28a7` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:35.907599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0e5a2cc4c04f43a73c96ee87af28a7)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:35.910908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:35.931423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702cbc8-bf4a-4a14-9e14-1b06cea34b11 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:35.954458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:35.955482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:35.955945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:35.957645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] PATH_INFO: `/v3/users/59719f5b4ccb48c6894798170b09618d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:35.965325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59719f5b4ccb48c6894798170b09618d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:35.977764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:36.036986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0e5a2cc4c04f43a73c96ee87af28a7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.038078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0e5a2cc4c04f43a73c96ee87af28a7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.040091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0e5a2cc4c04f43a73c96ee87af28a7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.077730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0e5a2cc4c04f43a73c96ee87af28a7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.097014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-31b28814-e76f-4d52-b135-5fc3e59480fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0e5a2cc4c04f43a73c96ee87af28a7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.129649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 864/1732] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:35 2022] DELETE /identity/v3/users/3e0e5a2cc4c04f43a73c96ee87af28a7 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:36.133934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:36.134529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:36.135028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:36.147812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59719f5b4ccb48c6894798170b09618d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.149761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:36.163430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59719f5b4ccb48c6894798170b09618d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.164179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59719f5b4ccb48c6894798170b09618d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.165809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:36.167341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:36.230185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59719f5b4ccb48c6894798170b09618d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.274211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59719f5b4ccb48c6894798170b09618d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:36.298113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 865/1733] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:36.306141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 869/1734] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:35 2022] DELETE /identity/v3/users/59719f5b4ccb48c6894798170b09618d => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:36.349999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:36.351858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:36.460642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:36.544293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d21a-c9dc-47c0-8cc7-1e5bffbd0773 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:36.683223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:36.684573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:36.684892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:36.685178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:36.913680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:36.915381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:36.938691 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 866/1735] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:39.119736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:39.121303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:39.146541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66ec9-4b78-4e71-837d-3e33b16bcd06 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:39.159186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:39.160551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:39.161070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.161070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.161383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] PATH_INFO: `/v3/projects/0d85f701624c4376bed42ecccb599066` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.162198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:39.171142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d85f701624c4376bed42ecccb599066)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:39.173369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:39.213214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58966b-7257-4048-a99d-f4ed55d8b7df service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:39.242145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:39.245036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.245319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.245596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] PATH_INFO: `/v3/projects/853bdf2ad18a44e79889702666782681` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.255352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853bdf2ad18a44e79889702666782681)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:39.273152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:39.409006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d85f701624c4376bed42ecccb599066', 'request_id': 'req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.425710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d85f701624c4376bed42ecccb599066', 'request_id': 'req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.441735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d85f701624c4376bed42ecccb599066', 'request_id': 'req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.465269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] The token cache is being invalidate because project 0d85f701624c4376bed42ecccb599066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:39.465646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.473761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bbdb7c4d-aa30-4ac0-b68e-e911273a5283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.476988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 870/1736] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:39 2022] DELETE /identity/v3/projects/0d85f701624c4376bed42ecccb599066 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:39.481490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6967-332f-4ae4-a832-a9488bcc08cb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.481894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6967-332f-4ae4-a832-a9488bcc08cb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.482342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6967-332f-4ae4-a832-a9488bcc08cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.499661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853bdf2ad18a44e79889702666782681', 'request_id': 'req-52ce8c5a-6c54-4f32-a452-a969985598a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.525773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-465b6967-332f-4ae4-a832-a9488bcc08cb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:39.535189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-465b6967-332f-4ae4-a832-a9488bcc08cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:39.539333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853bdf2ad18a44e79889702666782681', 'request_id': 'req-52ce8c5a-6c54-4f32-a452-a969985598a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.563833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853bdf2ad18a44e79889702666782681', 'request_id': 'req-52ce8c5a-6c54-4f32-a452-a969985598a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.608790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] The token cache is being invalidate because project 853bdf2ad18a44e79889702666782681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:39.609042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.610279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.612208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 867/1737] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:39 2022] DELETE /identity/v3/projects/853bdf2ad18a44e79889702666782681 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:39.618366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:39.622841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:39.665962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:39.718528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 871/1738] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:39.725749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.726135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.726511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.777118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:39.778510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:39.814736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 872/1739] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:39.816183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce8c5a-6c54-4f32-a452-a969985598a2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:39.820137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:39.830478 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:39.841748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678696bc-45c6-422b-b8d2-216267fe76ea None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:39.841989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.842384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.842673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] PATH_INFO: `/v3/users/10e4e482bfec4b6383c01ae785f17ce4` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.845706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e4e482bfec4b6383c01ae785f17ce4)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:39.848394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:39.864950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:39.865798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.866184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.866569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.867402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:39.867798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:39.869542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:39.899842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 873/1740] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:09:39.903724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:39.932619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a6d03-ab19-4e79-8504-c8fd656ca900 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:39.959862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:39.962230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:39.962530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:39.962812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:39.963519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:39.972384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:39.994632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e4e482bfec4b6383c01ae785f17ce4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.998221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e4e482bfec4b6383c01ae785f17ce4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:39.999585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e4e482bfec4b6383c01ae785f17ce4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:40.038404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e4e482bfec4b6383c01ae785f17ce4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:40.055799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 874/1741] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:39 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:40.060290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:40.063036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:40.063809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e4e482bfec4b6383c01ae785f17ce4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:40.086666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:40.103670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 868/1742] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:39 2022] DELETE /identity/v3/users/10e4e482bfec4b6383c01ae785f17ce4 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:40.211253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6399c-e769-40d2-9372-057cf4dc3bdf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:40.274587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:40.275560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:40.276040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:40.276988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:40.277891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:40.280220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:40.307502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 875/1743] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:40 2022] POST /identity/v3/users => generated 303 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:40.315206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:40.327866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b1b0-93da-4257-8ecd-400edbbc679c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:40.337814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:40.338516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:40.338803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:40.339082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:40.339828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:40.342335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:40.355930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 869/1744] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:40.359756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:40.373396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cf854-a726-4da6-8cbe-aa2add07c304 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:40.382908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46b0c8-f0b1-4b52-b7f5-6dd123f984b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:40.383882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46b0c8-f0b1-4b52-b7f5-6dd123f984b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:40.384260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46b0c8-f0b1-4b52-b7f5-6dd123f984b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:40.384625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46b0c8-f0b1-4b52-b7f5-6dd123f984b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:40.386274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46b0c8-f0b1-4b52-b7f5-6dd123f984b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:40.388869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46b0c8-f0b1-4b52-b7f5-6dd123f984b2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:40.410001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 876/1745] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:40.411586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:40.432712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e37d5-836d-4851-ae79-bda61ce6def1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:40.438783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:40.440138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:40.440525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:40.440946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] PATH_INFO: `/v3/projects/6029c9cd860e4cfb8c9b5103f02b8a56/users/f45f8481c39a4162b046d1ea36e60a4a/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:40.469557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6029c9cd860e4cfb8c9b5103f02b8a56, user_id=f45f8481c39a4162b046d1ea36e60a4a, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:40.473487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:40.496829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 870/1746] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:40 2022] PUT /identity/v3/projects/6029c9cd860e4cfb8c9b5103f02b8a56/users/f45f8481c39a4162b046d1ea36e60a4a/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:40.503243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:40.503888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:40.504623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:40.544866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:40.546366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:40.665299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 877/1747] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:40.698049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:40.701053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:40.831995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc435f2-b493-464b-b387-bc537c0fc364 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:40.837065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:40.837953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:40.838414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:40.838886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:40.850514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:40.852756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:40.860234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:40.866607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 871/1748] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:41.523160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:41.524901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:41.546689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30211dce-3f55-44fb-ab96-c7cb397ff266 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:41.568753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:41.569651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:41.570036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:41.570664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] PATH_INFO: `/v3/projects/95a7979c0f7847e9970344959d804250` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:41.573094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a7979c0f7847e9970344959d804250)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:41.575853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:41.685352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:41.765600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a7979c0f7847e9970344959d804250', 'request_id': 'req-73c251f9-b3e7-41c9-a248-517acb9ab43d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:41.780444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a7979c0f7847e9970344959d804250', 'request_id': 'req-73c251f9-b3e7-41c9-a248-517acb9ab43d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:41.820166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a7979c0f7847e9970344959d804250', 'request_id': 'req-73c251f9-b3e7-41c9-a248-517acb9ab43d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:41.888654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] The token cache is being invalidate because project 95a7979c0f7847e9970344959d804250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:41.889192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:41.901133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-73c251f9-b3e7-41c9-a248-517acb9ab43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:41.913821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 878/1749] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:41 2022] DELETE /identity/v3/projects/95a7979c0f7847e9970344959d804250 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:41.918276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:41.949047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e543-e31a-400c-99dc-c2fd42568e1a service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:42.159046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:42.164121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:42.164978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:42.165518 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] PATH_INFO: `/v3/users/55fae92b808c48d48cb0d55ff4266a66` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:42.174822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fae92b808c48d48cb0d55ff4266a66)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:42.178904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:42.353938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fae92b808c48d48cb0d55ff4266a66'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:42.355489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fae92b808c48d48cb0d55ff4266a66'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:42.356986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fae92b808c48d48cb0d55ff4266a66'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:42.411317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a779-4fe8-4569-8877-ca81f153984a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:42.411828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a779-4fe8-4569-8877-ca81f153984a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:42.412322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a779-4fe8-4569-8877-ca81f153984a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:42.416748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 879/1750] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:09:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:42.430730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fae92b808c48d48cb0d55ff4266a66'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:42.449571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:42.450045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:42.450641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:42.498169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-399db82c-0cf4-4138-bfad-4bced6b7a027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fae92b808c48d48cb0d55ff4266a66'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:42.562662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:42.571886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:42.573116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 872/1751] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:41 2022] DELETE /identity/v3/users/55fae92b808c48d48cb0d55ff4266a66 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:42.765478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 880/1752] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:42.826802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba164-17bd-477a-abed-ebd9e6148474 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:42.827472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba164-17bd-477a-abed-ebd9e6148474 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:42.828094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bba164-17bd-477a-abed-ebd9e6148474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:42.870985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-21bba164-17bd-477a-abed-ebd9e6148474 None None] MFA Rules not processed for user `3fb5eecf3e244058905ea3aba8112320`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:42.874535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-21bba164-17bd-477a-abed-ebd9e6148474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:42.991209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 873/1753] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:43.335640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:43.337391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:43.366239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:43.366458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:43.366939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:43.373080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb78d9-334b-408b-a961-c4488d2027a2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:43.385663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:43.386337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:43.386767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:43.387094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:43.409622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:43.411237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:43.434303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] MFA Rules not processed for user `f45f8481c39a4162b046d1ea36e60a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:43.435720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:43.438761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 881/1754] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:43.465206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:43.603054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 874/1755] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:43.604578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:43.606105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:43.663349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:43.665469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:43.746902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecc55d-1cca-406f-bac2-2b33438d9f0f service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:43.753800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:43.754835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:43.755272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:43.755738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:43.756589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:43.759336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:43.803842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 882/1756] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:43 2022] POST /identity/v3/projects => generated 403 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:43.809318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:43.824625 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42d9c0-a41a-4d7f-9bf6-e58365b09af5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:43.864291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:43.935121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:43.936274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:43.937574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:43.938015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] PATH_INFO: `/v3/projects/cba07b4637e44ba9a5d6b7a1218d73c4` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:43.940858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba07b4637e44ba9a5d6b7a1218d73c4)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:43.944025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.012926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba07b4637e44ba9a5d6b7a1218d73c4', 'request_id': 'req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:44.044732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba07b4637e44ba9a5d6b7a1218d73c4', 'request_id': 'req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:44.045032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0379e-5b91-4c73-9dc3-1ac349ee8c38 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.056660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba07b4637e44ba9a5d6b7a1218d73c4', 'request_id': 'req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:44.060487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:44.089694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] The token cache is being invalidate because project cba07b4637e44ba9a5d6b7a1218d73c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:44.091467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:44.093564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7b5ecbbe-8cea-4a1e-8dca-65ab95b4ba4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:44.097634 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 875/1757] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:43 2022] DELETE /identity/v3/projects/cba07b4637e44ba9a5d6b7a1218d73c4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:44.104539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58557bf5-a697-40fb-b81e-3468dea4a295 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.105684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58557bf5-a697-40fb-b81e-3468dea4a295 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.106033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58557bf5-a697-40fb-b81e-3468dea4a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.146741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-58557bf5-a697-40fb-b81e-3468dea4a295 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:44.148131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-58557bf5-a697-40fb-b81e-3468dea4a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:44.216130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.217935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.218397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.218940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.232807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.235110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.253856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 876/1758] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:44.262671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.263088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.263789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.286093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:44.286927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 883/1759] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:43 2022] POST /identity/v3/users => generated 308 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:44.290806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.292778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:44.293408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:44.309199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec3db-f899-46c2-9ef9-dda4558a4521 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.315439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 877/1760] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:44.317629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.320472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.321707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.322201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.322685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.323630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.325712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.328451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4158-a087-4dae-9054-04d9fa129634 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.338910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.339601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.339900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.340156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.340999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:44.341305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.342929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.362712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 884/1761] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:44.363919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.370756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 878/1762] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:09:44.375456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.391035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645e80c-80ed-46ff-a55d-5f930c3b57b8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.392897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826a7b-9267-45ab-a29d-e58ad0ef55dc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.402368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.403056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.403338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.403617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.404333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.404587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.406118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.406339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.406812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.407287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] PATH_INFO: `/v3/projects/832de1e131604ac58b0fde42ab3a9686/users/0025dc3187f54f1eb7d59f4470685e16/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.437489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] RBAC: Authorizing `identity:create_grant(project_id=832de1e131604ac58b0fde42ab3a9686, user_id=0025dc3187f54f1eb7d59f4470685e16, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.445078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 879/1763] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:44 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:44.445348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.453542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.468464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 885/1764] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:44 2022] PUT /identity/v3/projects/832de1e131604ac58b0fde42ab3a9686/users/0025dc3187f54f1eb7d59f4470685e16/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:44.479497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.543071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff437f1-e51d-47c5-b36a-3be62e5971ce admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.567518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980eb6-01b9-49a4-8f1a-3832fb9d254c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.574190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.575200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.576048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.576751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.577698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.586301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.614779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 886/1765] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:44.617471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.631849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:44.634499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04672c4-ef7e-412b-9afe-356c105d7f89 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.640827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.641563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.641875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.642219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.644709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.645334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.646514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.646980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.647464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] PATH_INFO: `/v3/projects/832de1e131604ac58b0fde42ab3a9686/users/0025dc3187f54f1eb7d59f4470685e16/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.647596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.650295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832de1e131604ac58b0fde42ab3a9686, user_id=0025dc3187f54f1eb7d59f4470685e16, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.653847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.676760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 887/1766] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:44 2022] PUT /identity/v3/projects/832de1e131604ac58b0fde42ab3a9686/users/0025dc3187f54f1eb7d59f4470685e16/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:44.684105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 880/1767] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:44 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:44.688586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.699694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:44.795208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9b3e-b719-4dcb-aa86-51bf6b956e53 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.802281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.802926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.803279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.803622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.804500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.806170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.830659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 888/1768] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:44.834998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.845684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f093fb-7d20-4fb0-862d-0d6a00949e1f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.851858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59867-0943-47dc-a02d-6edea983a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.852824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59867-0943-47dc-a02d-6edea983a7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.853268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59867-0943-47dc-a02d-6edea983a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.853722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59867-0943-47dc-a02d-6edea983a7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.854665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59867-0943-47dc-a02d-6edea983a7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.856346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59867-0943-47dc-a02d-6edea983a7c9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.868728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 881/1769] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:44.872975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:44.884612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea047-4559-4d70-bbad-960403849b8e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:44.891050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:44.892537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.892925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.893204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] PATH_INFO: `/v3/projects/c3908a3fd97549ffa4c920743d2631bc/users/3b35dc45fba046b98f07e6c144197d71/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:44.914737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3908a3fd97549ffa4c920743d2631bc, user_id=3b35dc45fba046b98f07e6c144197d71, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:44.918127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:44.950103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 889/1770] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:44 2022] PUT /identity/v3/projects/c3908a3fd97549ffa4c920743d2631bc/users/3b35dc45fba046b98f07e6c144197d71/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:44.952194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:44.952493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:44.952812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.010826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] MFA Rules not processed for user `3b35dc45fba046b98f07e6c144197d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:45.012115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:45.099361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:45.100403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 882/1771] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:45.211743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9585-01b7-4b5f-bc7d-62f4e91e69ab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:45.217301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:45.218531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:45.219024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:45.219567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.220466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:45.233274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:45.281452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 890/1772] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:45 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:45.286463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:45.305104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856637-5e36-4b6b-bca1-afca71b34713 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:45.499639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:45.505767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:45.507292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:45.508214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.509855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:45.513207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:45.586733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 883/1773] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:45 2022] POST /identity/v3/users => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:45.589008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:45.617876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e62163-43d5-41b4-90f8-0df7e2c8ebc4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:45.626875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:45.628074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:45.628189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:45.628910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.630166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:45.632481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:45.653072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 891/1774] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:45.657185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:45.691729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded43ecb-1cd8-4a25-9f2d-abf8148b3f91 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:45.697836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:45.699959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:45.700260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:45.700543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] PATH_INFO: `/v3/projects/c1c8eef4c0794fe792331ef81f864519/users/a6bcd33b49e844d8abb5340e0f7c12e8/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.726560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c8eef4c0794fe792331ef81f864519, user_id=a6bcd33b49e844d8abb5340e0f7c12e8, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:45.729639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:45.751974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 884/1775] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:45 2022] PUT /identity/v3/projects/c1c8eef4c0794fe792331ef81f864519/users/a6bcd33b49e844d8abb5340e0f7c12e8/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:45.756908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:45.782318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322292e-29e0-4a7c-bcbd-239b66728900 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:45.883111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:45.903396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a374b-93ff-4547-9f6f-2d049c677a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:45.904129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a374b-93ff-4547-9f6f-2d049c677a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:45.904639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a374b-93ff-4547-9f6f-2d049c677a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:45.904968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a374b-93ff-4547-9f6f-2d049c677a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.906161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a374b-93ff-4547-9f6f-2d049c677a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:45.908713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a374b-93ff-4547-9f6f-2d049c677a1d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:45.928776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 892/1776] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:45.933036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:45.947516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaba01-273c-4907-919a-8ec966da60bd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:45.960541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd38859-9976-4c57-9347-92fa49fd6118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:45.961505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38859-9976-4c57-9347-92fa49fd6118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:45.961784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38859-9976-4c57-9347-92fa49fd6118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:45.962060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38859-9976-4c57-9347-92fa49fd6118 admin admin] PATH_INFO: `/v3/projects/c1c8eef4c0794fe792331ef81f864519/users/a6bcd33b49e844d8abb5340e0f7c12e8/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:45.968523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd38859-9976-4c57-9347-92fa49fd6118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c8eef4c0794fe792331ef81f864519, user_id=a6bcd33b49e844d8abb5340e0f7c12e8, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:45.972095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd38859-9976-4c57-9347-92fa49fd6118 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:46.014290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 885/1777] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:45 2022] PUT /identity/v3/projects/c1c8eef4c0794fe792331ef81f864519/users/a6bcd33b49e844d8abb5340e0f7c12e8/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:46.016330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:46.016910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:46.017271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:46.061134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] MFA Rules not processed for user `a6bcd33b49e844d8abb5340e0f7c12e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:46.064279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:46.204073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32cc6-c465-4451-8271-3e1ac414a480 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:46.205102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32cc6-c465-4451-8271-3e1ac414a480 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:46.205827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32cc6-c465-4451-8271-3e1ac414a480 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:46.207686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 886/1778] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:09:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:09:46.226256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 893/1779] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:46.234754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:46.236005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:46.236741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:46.239933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:46.243697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:46.280662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:46.285445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:46.319137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:46.405898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f717-a67d-4af8-a324-3c2caca0bd8c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:46.426520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2848-3aff-4334-9ce0-523302bb3394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:46.428831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2848-3aff-4334-9ce0-523302bb3394 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:46.429466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2848-3aff-4334-9ce0-523302bb3394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:46.429754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2848-3aff-4334-9ce0-523302bb3394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:46.461641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2848-3aff-4334-9ce0-523302bb3394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:46.462935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 887/1780] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:09:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:46.463554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2848-3aff-4334-9ce0-523302bb3394 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:46.476486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 894/1781] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:46.570160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:46.584935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd95509-1bef-400b-8719-9c2c8e7991b9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:46.595712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:46.597378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:46.597899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:46.598199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:46.692502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:46.694178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:46.710040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 888/1782] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:46.773101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa82f-fe0e-4f7f-84cb-361aeab8e6a0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:46.773560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa82f-fe0e-4f7f-84cb-361aeab8e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:46.773637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa82f-fe0e-4f7f-84cb-361aeab8e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:46.821895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-512fa82f-fe0e-4f7f-84cb-361aeab8e6a0 None None] MFA Rules not processed for user `0025dc3187f54f1eb7d59f4470685e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:46.824227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-512fa82f-fe0e-4f7f-84cb-361aeab8e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:46.971014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:46.981924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 895/1783] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:47.043156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:47.045230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:47.087284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1eaf-28cb-4b1b-b1a4-7aebcd44a56e service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:47.105095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a1b04-3875-41c9-bdef-9174b8028877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:47.105770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a1b04-3875-41c9-bdef-9174b8028877 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:47.106082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a1b04-3875-41c9-bdef-9174b8028877 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:47.106322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a1b04-3875-41c9-bdef-9174b8028877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:47.125749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a1b04-3875-41c9-bdef-9174b8028877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:47.131425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a1b04-3875-41c9-bdef-9174b8028877 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:47.172176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 889/1784] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:49.208486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9110-d615-407a-bdc3-0a15044e1bfa None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:49.209443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9110-d615-407a-bdc3-0a15044e1bfa None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:49.209926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e9110-d615-407a-bdc3-0a15044e1bfa None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:49.212175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 896/1785] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:09:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:09:49.258067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:49.258544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:49.258641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:49.312099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:49.313495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:49.467427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 890/1786] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:09:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:49.493221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9110-d615-407a-bdc3-0a15044e1bfa None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:49.495272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e09e9110-d615-407a-bdc3-0a15044e1bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:49.526134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e9110-d615-407a-bdc3-0a15044e1bfa None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:49.535483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7c27-86ee-4e05-96a4-f10f4ce75a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:49.536525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7c27-86ee-4e05-96a4-f10f4ce75a8f service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:49.537018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7c27-86ee-4e05-96a4-f10f4ce75a8f service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:49.537500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7c27-86ee-4e05-96a4-f10f4ce75a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:49.548364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7c27-86ee-4e05-96a4-f10f4ce75a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:49.567677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7c27-86ee-4e05-96a4-f10f4ce75a8f service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:49.633692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 897/1787] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:51.179203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:51.240498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:51.312012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9ea14-8095-4290-a815-36ad18aa5252 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:51.320488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:51.321987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:51.322100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:51.322466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] PATH_INFO: `/v3/users/3b35dc45fba046b98f07e6c144197d71` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:51.323825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b35dc45fba046b98f07e6c144197d71)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:51.325920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:51.415531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b35dc45fba046b98f07e6c144197d71'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:51.417092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b35dc45fba046b98f07e6c144197d71'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:51.419887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b35dc45fba046b98f07e6c144197d71'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:51.445016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b35dc45fba046b98f07e6c144197d71'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:51.458587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-65cd619a-0a6b-4a23-95c4-a86be19cd153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b35dc45fba046b98f07e6c144197d71'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:51.463895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf51f3-8e12-44cb-b38e-337c48bda79b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:51.464385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf51f3-8e12-44cb-b38e-337c48bda79b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:51.464478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf51f3-8e12-44cb-b38e-337c48bda79b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:51.466087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 898/1788] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 17:09:51.487163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:51.488501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:51.488863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:51.491806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 891/1789] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:51 2022] DELETE /identity/v3/users/3b35dc45fba046b98f07e6c144197d71 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:51.497248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:51.499623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:51.499623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:51.524820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] MFA Rules not processed for user `46555ca1a1404b94a39486d73a017f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:51.526254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:51.597546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:51.598315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:51.716117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 899/1790] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:09:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:51.737998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 892/1791] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:51.752007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:51.753914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:51.764282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:51.775760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:51.833572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db43035-129b-4b1f-8416-653985b211a9 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:51.864345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:51.865650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:51.866065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:51.866453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] PATH_INFO: `/v3/users/f45f8481c39a4162b046d1ea36e60a4a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:51.872767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45f8481c39a4162b046d1ea36e60a4a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:51.878530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92d422-ce2f-4415-9344-2db5f9c86290 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:51.882151 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:51.887248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:51.888217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:51.888779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:51.889789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:51.930747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:51.932288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:51.963534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 900/1792] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:51.964541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:51.972025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:51.988516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:52.000110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45f8481c39a4162b046d1ea36e60a4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:52.007117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a62e1-4009-43ea-8a0b-14b2d02c895a service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:52.011744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45f8481c39a4162b046d1ea36e60a4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:52.014969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45f8481c39a4162b046d1ea36e60a4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:52.026980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:52.028638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:52.029807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:52.030830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:52.043297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:52.082443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45f8481c39a4162b046d1ea36e60a4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:52.085767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:52.092846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:52.106187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45f8481c39a4162b046d1ea36e60a4a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:52.125703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 901/1793] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:09:52.148489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 893/1794] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:51 2022] DELETE /identity/v3/users/f45f8481c39a4162b046d1ea36e60a4a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:53.032585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:53.034190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:53.048516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4c3a9-6818-41ae-ac11-6aa9bba278df service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:53.159572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:53.161439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:53.161841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:53.163057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] PATH_INFO: `/v3/projects/6029c9cd860e4cfb8c9b5103f02b8a56` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:53.165102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6029c9cd860e4cfb8c9b5103f02b8a56)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:53.168241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:53.203535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:53.357731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6029c9cd860e4cfb8c9b5103f02b8a56', 'request_id': 'req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.376644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6029c9cd860e4cfb8c9b5103f02b8a56', 'request_id': 'req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.385914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6029c9cd860e4cfb8c9b5103f02b8a56', 'request_id': 'req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.404651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] The token cache is being invalidate because project 6029c9cd860e4cfb8c9b5103f02b8a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:53.404651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.404651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.406884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 902/1795] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:53 2022] DELETE /identity/v3/projects/6029c9cd860e4cfb8c9b5103f02b8a56 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:53.414532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:53.426624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74fb8-b112-4a04-bf80-de78059d73c9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:53.502903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:53.504340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:53.505137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:53.505504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] PATH_INFO: `/v3/users/0025dc3187f54f1eb7d59f4470685e16` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:53.507152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0025dc3187f54f1eb7d59f4470685e16)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:53.509660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:53.584882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0025dc3187f54f1eb7d59f4470685e16'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.586735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0025dc3187f54f1eb7d59f4470685e16'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.586735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0025dc3187f54f1eb7d59f4470685e16'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.596553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:53.597983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:53.619319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85aa1-3547-4ba0-9d5c-d7f10918f9e5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:53.621763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0025dc3187f54f1eb7d59f4470685e16'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.633269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:53.634238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:53.634530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:53.634815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] PATH_INFO: `/v3/projects/c3908a3fd97549ffa4c920743d2631bc` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:53.636147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3908a3fd97549ffa4c920743d2631bc)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:53.638208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:53.642100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0025dc3187f54f1eb7d59f4470685e16'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.685120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 894/1796] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:53 2022] DELETE /identity/v3/users/0025dc3187f54f1eb7d59f4470685e16 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:53.778218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3908a3fd97549ffa4c920743d2631bc', 'request_id': 'req-261c054f-1e38-4783-abfe-ccb33fb84e4a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.802318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3908a3fd97549ffa4c920743d2631bc', 'request_id': 'req-261c054f-1e38-4783-abfe-ccb33fb84e4a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.809999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3908a3fd97549ffa4c920743d2631bc', 'request_id': 'req-261c054f-1e38-4783-abfe-ccb33fb84e4a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.858808 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] The token cache is being invalidate because project c3908a3fd97549ffa4c920743d2631bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:53.859205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.859947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:53.862911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 903/1797] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:53 2022] DELETE /identity/v3/projects/c3908a3fd97549ffa4c920743d2631bc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:53.868992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:53.874391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:53.985607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:54.029944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530919-9fbf-4025-819a-78b996371355 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.140617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.142949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.187061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.189187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.191492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.191788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] PATH_INFO: `/v3/users/a6bcd33b49e844d8abb5340e0f7c12e8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.193831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bcd33b49e844d8abb5340e0f7c12e8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.201705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.305428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bcd33b49e844d8abb5340e0f7c12e8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.306050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c054f-1e38-4783-abfe-ccb33fb84e4a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.306252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bcd33b49e844d8abb5340e0f7c12e8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.306884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bcd33b49e844d8abb5340e0f7c12e8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.312732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.314188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.315173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.315610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] PATH_INFO: `/v3/projects/832de1e131604ac58b0fde42ab3a9686` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.317015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=832de1e131604ac58b0fde42ab3a9686)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.319242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.342181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bcd33b49e844d8abb5340e0f7c12e8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.351338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9063e8f7-52b1-45c8-91ae-67633049efa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bcd33b49e844d8abb5340e0f7c12e8'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.374012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 895/1798] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:09:53 2022] DELETE /identity/v3/users/a6bcd33b49e844d8abb5340e0f7c12e8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:54.376389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:54.398115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832de1e131604ac58b0fde42ab3a9686', 'request_id': 'req-b2517aa3-6a16-41d5-9c59-eca60ad474ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.407059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832de1e131604ac58b0fde42ab3a9686', 'request_id': 'req-b2517aa3-6a16-41d5-9c59-eca60ad474ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.414828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832de1e131604ac58b0fde42ab3a9686', 'request_id': 'req-b2517aa3-6a16-41d5-9c59-eca60ad474ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.428476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] The token cache is being invalidate because project 832de1e131604ac58b0fde42ab3a9686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:54.428799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.429537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b2517aa3-6a16-41d5-9c59-eca60ad474ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.431095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 904/1799] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:54 2022] DELETE /identity/v3/projects/832de1e131604ac58b0fde42ab3a9686 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:54.436040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.436590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.436590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.457282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:54.458501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.526110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 896/1800] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:54.541660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.542959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.544590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.566292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:54.567500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.581386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 905/1801] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:54.585696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.606633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624ff5-3c57-46ed-be01-8f2ad2ba5d10 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.611874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.612554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.612866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.613143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.613871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:54.614178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.615783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.618268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:54.634180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 897/1802] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:54.635043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.645332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bc6bc-7e2e-4b39-a591-82076fbc6a13 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.650273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.651017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.651304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.651580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.652272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.654266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.679040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.684033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.694208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 906/1803] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:54 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:54.699636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc55f-8601-4e6b-a0e6-7c2d2c05937b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.701822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.766785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.767695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.767835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acec8-d8e7-4d05-be00-9c9edcb06e6d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.768062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.768231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] PATH_INFO: `/v3/projects/c1c8eef4c0794fe792331ef81f864519` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.769433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c8eef4c0794fe792331ef81f864519)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.771356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.773241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.773948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.774227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.774537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.775222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.777317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.807669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 907/1804] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:54 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:54.809331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.825943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3ff1-b25a-4919-b6ad-45ee1e0447ef admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.841992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c8eef4c0794fe792331ef81f864519', 'request_id': 'req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.853957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c8eef4c0794fe792331ef81f864519', 'request_id': 'req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.865801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c8eef4c0794fe792331ef81f864519', 'request_id': 'req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.884526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] The token cache is being invalidate because project c1c8eef4c0794fe792331ef81f864519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:09:54.885115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.886112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5f6653c-fcd1-4067-8241-4d1d0878b5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:09:54.888382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 898/1805] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:09:54 2022] DELETE /identity/v3/projects/c1c8eef4c0794fe792331ef81f864519 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:54.894817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487d304-0650-4557-85c2-ec4dc2bbb516 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.895142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487d304-0650-4557-85c2-ec4dc2bbb516 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.895405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487d304-0650-4557-85c2-ec4dc2bbb516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.905874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.906604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.906910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.907259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.908645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.910705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.923210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 908/1806] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:54.926579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0487d304-0650-4557-85c2-ec4dc2bbb516 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:54.927546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0487d304-0650-4557-85c2-ec4dc2bbb516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.929778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.931556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.945049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 899/1807] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:54.949160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.949627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.950038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.952516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0724c2-3eee-4576-9315-e20e2600ec38 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:54.962024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:54.962833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:54.963115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:54.963392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:54.964130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:54.966592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:54.972566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:54.975647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:54.989203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 900/1808] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:54.989407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 909/1809] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:54.993134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.993290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:54.998679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:55.003990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c36d2-1196-4625-a191-2216a50f948d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.009069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.009782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.010070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.010352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.011090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:09:55.011401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.014199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.020627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202306-8d01-4f83-a758-5d933c4a8fd2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.026558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d36c79-88b5-47b1-9bbc-7fb63f228f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.027644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d36c79-88b5-47b1-9bbc-7fb63f228f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.028016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d36c79-88b5-47b1-9bbc-7fb63f228f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.028388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d36c79-88b5-47b1-9bbc-7fb63f228f99 admin admin] PATH_INFO: `/v3/projects/4ad15499ceab4025a17be396e01248a9/users/76947bc0a8284e56a1c500f956ddb9f4/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.031273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 901/1810] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:09:55.032208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.046503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45032733-5f80-45a5-a6f9-cd07d7e422a8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.046689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d36c79-88b5-47b1-9bbc-7fb63f228f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad15499ceab4025a17be396e01248a9, user_id=76947bc0a8284e56a1c500f956ddb9f4, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.050618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d36c79-88b5-47b1-9bbc-7fb63f228f99 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.052397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.053178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.053463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.053746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.054443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.056711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.068941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 910/1811] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:54 2022] PUT /identity/v3/projects/4ad15499ceab4025a17be396e01248a9/users/76947bc0a8284e56a1c500f956ddb9f4/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:55.079727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.080097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.080978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.092004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 902/1812] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:55.097044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.119411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] MFA Rules not processed for user `76947bc0a8284e56a1c500f956ddb9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:55.120848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:55.164896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:55.190073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417b8a-ef70-4e17-8430-53964cf24f25 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.195012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.195710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.196037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.196319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.197049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.197398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 911/1813] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:09:55.199583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.202003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.219550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a163-fb3b-4741-b40b-03ce9210568c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.224819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 903/1814] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:55.229165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.229312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.229852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.230131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.230604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.231298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.233294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.241337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18322df-7ff7-4205-aba9-7366df20961d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.248584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.249408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.249690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.250283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.250697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.253817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.265005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 904/1815] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:55.265866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 912/1816] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:55.270486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.270627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.281818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c007-f14c-47cd-af04-2a59f2d381e4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.356561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.357291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.357648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9a3e6-48cc-401a-ba01-fa74b3b95928 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.357745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.358013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.358705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.360699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.363814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.364493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.364825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.365100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.365924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.370036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.384444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 913/1817] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:55.388582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.394299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 905/1818] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:09:55.395609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.401388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2e4e-2d9f-40ae-8906-f926e2856f93 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.407510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca1cfe-7915-4d6f-9692-9dccbb2f8e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.409892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca1cfe-7915-4d6f-9692-9dccbb2f8e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.410190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca1cfe-7915-4d6f-9692-9dccbb2f8e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.410472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca1cfe-7915-4d6f-9692-9dccbb2f8e53 admin admin] PATH_INFO: `/v3/projects/346747cc0aa848488caaf14b20a4d735/users/ecfc71bb018644ea967a5fdf98ce48c8/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.412024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059d6b-88dd-42f7-8909-8beadaa2489a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.418853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.419563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.419822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.420604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.421467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.425332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.436443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 906/1819] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:55.441089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca1cfe-7915-4d6f-9692-9dccbb2f8e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346747cc0aa848488caaf14b20a4d735, user_id=ecfc71bb018644ea967a5fdf98ce48c8, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.441307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.444036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca1cfe-7915-4d6f-9692-9dccbb2f8e53 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.455778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f08a0-8d37-4ad9-be55-fc36e3517d0e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.462480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 914/1820] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:55 2022] PUT /identity/v3/projects/346747cc0aa848488caaf14b20a4d735/users/ecfc71bb018644ea967a5fdf98ce48c8/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:55.474622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.475002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.475288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.515724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] MFA Rules not processed for user `ecfc71bb018644ea967a5fdf98ce48c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:55.517212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:55.524999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:55.542264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.544168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.544811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.545171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] PATH_INFO: `/v3/projects/8281317e75034f3f95cfc73d794576f4/users/e8f3e145d133479fb711ece7b3eddbb9/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.563232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8281317e75034f3f95cfc73d794576f4, user_id=e8f3e145d133479fb711ece7b3eddbb9, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.567205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.583080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 907/1821] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:55 2022] PUT /identity/v3/projects/8281317e75034f3f95cfc73d794576f4/users/e8f3e145d133479fb711ece7b3eddbb9/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:55.586906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.604446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 915/1822] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:55.608708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:55.608968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.620288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217742d-0b11-43fe-a52e-13f7eb4835ee None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.653395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f8bb2-a340-4ba4-bf94-45c104cfd510 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.658093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.658789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.659071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.659342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.660062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.661690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.674892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 908/1823] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:09:55.675989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.683776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eef56-8873-46f4-b515-977a2df844ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.684644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eef56-8873-46f4-b515-977a2df844ec admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.685091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eef56-8873-46f4-b515-977a2df844ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.685524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eef56-8873-46f4-b515-977a2df844ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.686225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eef56-8873-46f4-b515-977a2df844ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.686369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626c5e0-d2d5-436c-ae3f-3532d87a59cf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.688655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eef56-8873-46f4-b515-977a2df844ec admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.691863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.692970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.693261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.693545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] PATH_INFO: `/v3/projects/8281317e75034f3f95cfc73d794576f4/users/e8f3e145d133479fb711ece7b3eddbb9/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.695900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8281317e75034f3f95cfc73d794576f4, user_id=e8f3e145d133479fb711ece7b3eddbb9, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.699074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.712194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 909/1824] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:55 2022] PUT /identity/v3/projects/8281317e75034f3f95cfc73d794576f4/users/e8f3e145d133479fb711ece7b3eddbb9/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:55.716924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 916/1825] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:55.721245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.722267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.722818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.723106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.753064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] MFA Rules not processed for user `e8f3e145d133479fb711ece7b3eddbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:55.754290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:55.791351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0506-6907-469e-b77b-2199440fd27d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.828123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 917/1826] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:55.841191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.842601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:55.855127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.855810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.856099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.856375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.857113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.859048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.863181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:55.887237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 910/1827] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:09:55 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:09:55.888210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.899148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e776e-6448-41dc-843e-98311b682c22 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.902655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2aaec-6449-4614-8ea6-9f7f4ca66c06 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.904300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.905014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.905300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.905636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.906363 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.906929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.907688 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.908009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.908377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.909009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.919402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.921001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 911/1828] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:55.921116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.925534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.930981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 918/1829] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:09:55.935400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a178cee-8ce0-44e7-9051-806b4ab0d170 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:55.941128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:55.941962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:55.942251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:55.942536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] PATH_INFO: `/v3/projects/c14dcdd75c9f4f7e91f4820d3bd1fd21/users/03a004949a474b15922bc686a4f3f006/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:55.959411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14dcdd75c9f4f7e91f4820d3bd1fd21, user_id=03a004949a474b15922bc686a4f3f006, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:55.962112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:55.978352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 912/1830] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:55 2022] PUT /identity/v3/projects/c14dcdd75c9f4f7e91f4820d3bd1fd21/users/03a004949a474b15922bc686a4f3f006/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:09:55.982353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:55.994881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6005a0-bd69-4f2b-8143-04aa973a1788 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:56.009670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:56.014252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:09:56.054264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:56.055072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:56.055438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:56.055711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:56.056428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:56.058058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:56.072298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 919/1831] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:09:56.072475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002e96b-b3c2-40bf-a7ab-c0cce3dafa55 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:56.073068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:56.073716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:56.073851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:56.073992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:56.074264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:56.083921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139e718-badb-45a3-9df3-4d6fa4ec1e6e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:56.088772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5297d1-497c-43e3-99a9-0ee0ac66c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:56.089641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5297d1-497c-43e3-99a9-0ee0ac66c30c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:56.089917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5297d1-497c-43e3-99a9-0ee0ac66c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:56.090188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5297d1-497c-43e3-99a9-0ee0ac66c30c admin admin] PATH_INFO: `/v3/projects/c14dcdd75c9f4f7e91f4820d3bd1fd21/users/03a004949a474b15922bc686a4f3f006/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:56.092268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5297d1-497c-43e3-99a9-0ee0ac66c30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14dcdd75c9f4f7e91f4820d3bd1fd21, user_id=03a004949a474b15922bc686a4f3f006, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:56.095067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5297d1-497c-43e3-99a9-0ee0ac66c30c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:56.106222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 920/1832] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:09:56 2022] PUT /identity/v3/projects/c14dcdd75c9f4f7e91f4820d3bd1fd21/users/03a004949a474b15922bc686a4f3f006/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:09:56.118410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:56.118717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:56.118978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:56.134769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:56.136499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:56.145707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 913/1833] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:09:56.146422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] MFA Rules not processed for user `03a004949a474b15922bc686a4f3f006`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:09:56.147685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:56.242631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 921/1834] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:09:56.258947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:09:56.258947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:09:56.272275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290859-3edb-4019-b49a-19c5f32965de service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:09:56.342405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726611c7-ac91-491b-ae74-447860791909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:09:56.343062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726611c7-ac91-491b-ae74-447860791909 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:09:56.343340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726611c7-ac91-491b-ae74-447860791909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:09:56.343613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726611c7-ac91-491b-ae74-447860791909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:09:56.406682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726611c7-ac91-491b-ae74-447860791909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:09:56.409032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726611c7-ac91-491b-ae74-447860791909 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:09:56.420105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 914/1835] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:09:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:00.239791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:00.241270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:00.273459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:00.307167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7101f-6449-4213-887e-e65503b41a84 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:00.311716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:00.312580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:00.312914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:00.313178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] PATH_INFO: `/v3/users/1e841f91005e441e9c76a0f24bf60025` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:00.315458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e841f91005e441e9c76a0f24bf60025)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:00.317453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:00.363503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e841f91005e441e9c76a0f24bf60025'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:00.370811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e841f91005e441e9c76a0f24bf60025'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:00.371422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e841f91005e441e9c76a0f24bf60025'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:00.383696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e841f91005e441e9c76a0f24bf60025'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:00.390404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e841f91005e441e9c76a0f24bf60025'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:00.406495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 922/1836] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:00 2022] DELETE /identity/v3/users/1e841f91005e441e9c76a0f24bf60025 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:00.411602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:00.412099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:00.412380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:00.430378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:00.431609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:00.436812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:00.501148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 915/1837] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:00.536186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:00.538098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:00.603926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07cbf-cae9-4b50-b3d9-de1faadbee78 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:00.607681 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:00.608334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:00.608650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:00.609057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:00.618602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:00.619964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:00.629890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 923/1838] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:00.896540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:00.898756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:00.918182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda279f-f640-4795-8087-da0755c8a668 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:00.922963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:00.924128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:00.924414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:00.924724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] PATH_INFO: `/v3/projects/53636e313a7e42478677da440f1ab316` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:00.926505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53636e313a7e42478677da440f1ab316)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:00.929771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:00.995198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53636e313a7e42478677da440f1ab316', 'request_id': 'req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.008996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53636e313a7e42478677da440f1ab316', 'request_id': 'req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.017686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53636e313a7e42478677da440f1ab316', 'request_id': 'req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.029335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] The token cache is being invalidate because project 53636e313a7e42478677da440f1ab316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:01.029633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.030420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.032211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 916/1839] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:00 2022] DELETE /identity/v3/projects/53636e313a7e42478677da440f1ab316 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:01.038777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:01.054730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35bfa-8370-4440-adb5-ae4e52f0b251 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:01.130105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:01.147370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:01.148266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:01.149967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:01.150244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] PATH_INFO: `/v3/users/a0f8809b5b9d446985281d83ad9f831a` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:01.151524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f8809b5b9d446985281d83ad9f831a)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:01.154328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:01.215729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f8809b5b9d446985281d83ad9f831a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.223360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f8809b5b9d446985281d83ad9f831a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.224105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f8809b5b9d446985281d83ad9f831a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.238414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f8809b5b9d446985281d83ad9f831a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.247303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dcb22fab-cf2a-4562-af51-ead967249571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f8809b5b9d446985281d83ad9f831a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.254227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 924/1840] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:01 2022] DELETE /identity/v3/users/a0f8809b5b9d446985281d83ad9f831a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:01.586325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:01.594028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:01.629708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3124e4-5005-4ef8-9c6b-a4a9ad1ca123 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:01.714206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:01.715641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:01.716123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:01.716590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] PATH_INFO: `/v3/projects/bd37c017191f4692a88f7bbb0cb4345c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:01.718830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd37c017191f4692a88f7bbb0cb4345c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:01.722378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:01.781793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:01.797373 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd37c017191f4692a88f7bbb0cb4345c', 'request_id': 'req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.807593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd37c017191f4692a88f7bbb0cb4345c', 'request_id': 'req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.816783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd37c017191f4692a88f7bbb0cb4345c', 'request_id': 'req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.828407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] The token cache is being invalidate because project bd37c017191f4692a88f7bbb0cb4345c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:01.828809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.830753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3d4eb3b-2f21-4f8c-a6b1-efa22e1685cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:01.833404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 917/1841] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:01 2022] DELETE /identity/v3/projects/bd37c017191f4692a88f7bbb0cb4345c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:01.840735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:01.841301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:01.841630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:01.867380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:01.868629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:01.936731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 925/1842] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:01.949287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:01.949574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:01.949854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:01.969744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:01.971048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:01.979680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 918/1843] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:01.984054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:01.995123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584aa74-2be6-42cc-a4bc-23b7c73014eb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.000370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.001141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.001422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.002262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.003167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:02.003475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.005088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.018177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 926/1844] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:02.022703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.037018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f7521-5594-419c-a6e6-ec172f3924e6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.041693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.042346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.042630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.042902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.043600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.045562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.073064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 919/1845] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:02 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:02.078067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.103596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405ec2-5296-462d-b9c7-c64e5c02ba8b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.223506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:02.232907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.233671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.234185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.234723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.235352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.239203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.268873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 927/1846] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:02 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:02.272222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.294182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8293-a0de-4e49-b957-dad66fcec2b8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.307037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.310076 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.310693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.311789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.321172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.323093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.340295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 920/1847] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:02.341947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.355715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2614c2-1257-4439-b645-d7e2d79f20f0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.362917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0d8ed-4939-46f7-8fce-6c58e646a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.363761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8ed-4939-46f7-8fce-6c58e646a7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.364187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8ed-4939-46f7-8fce-6c58e646a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.364664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d8ed-4939-46f7-8fce-6c58e646a7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.365584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d8ed-4939-46f7-8fce-6c58e646a7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.367193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0d8ed-4939-46f7-8fce-6c58e646a7e9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.384036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 928/1848] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:02.385008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.409757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefc3a4-1254-42b8-9cf0-d189635631e2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.416925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.418124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.418626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.419102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] PATH_INFO: `/v3/projects/c5592e7ef53b487088cf4e06107c544e/users/308cda3ae27945e9867d873bf3580767/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.446021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5592e7ef53b487088cf4e06107c544e, user_id=308cda3ae27945e9867d873bf3580767, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.448914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.476734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 921/1849] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:02 2022] PUT /identity/v3/projects/c5592e7ef53b487088cf4e06107c544e/users/308cda3ae27945e9867d873bf3580767/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:02.494030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.494494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.494791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.559411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] MFA Rules not processed for user `308cda3ae27945e9867d873bf3580767`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:02.560720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:02.706599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 929/1850] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:02.710831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.800928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b660973-c217-4d22-8f78-a2996c303bfa admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.806859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.807552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.807837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.808143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.808903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.811000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:02.846868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 922/1851] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:02 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:02.847587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:02.860193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a72073-1650-4345-b90e-6d4e20b50352 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:02.982310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:02.983074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:02.983370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:02.983651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:02.984410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:02.987790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.009411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 930/1852] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:02 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:03.014261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:03.042863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82a4da-09fa-4c83-9d9d-6e093a7403f1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:03.053953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:03.054237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.054522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.054807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.055546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:03.057266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.076313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 923/1853] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:03.081825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:03.095025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56165-a448-4eab-b077-9d6f0e9066ec admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:03.103717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:03.105075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.105547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.106006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] PATH_INFO: `/v3/projects/04a4c561bfc14d54897f5ea405610b5e/users/f0d28cb4d974412488ec48c2ccde335c/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.141329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a4c561bfc14d54897f5ea405610b5e, user_id=f0d28cb4d974412488ec48c2ccde335c, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:03.141329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.151542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:03.154348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:03.159209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 931/1854] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:03 2022] PUT /identity/v3/projects/04a4c561bfc14d54897f5ea405610b5e/users/f0d28cb4d974412488ec48c2ccde335c/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:03.160490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:03.197427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:03.198675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:03.218972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a309be-fc11-4e98-9ed0-8fea31cbd830 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:03.229318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87549b-8c86-43cf-896b-696cc34525fa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:03.234011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:03.234677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.234964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.235239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.236082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:03.237986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.247821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 932/1855] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:03.252878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:03.262319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d6dac-b8d6-481d-9856-a286ce1b6578 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:03.266989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fef0c-3955-44ee-a251-e5fe8219ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:03.268417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fef0c-3955-44ee-a251-e5fe8219ac2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.268719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fef0c-3955-44ee-a251-e5fe8219ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.268996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fef0c-3955-44ee-a251-e5fe8219ac2c admin admin] PATH_INFO: `/v3/projects/04a4c561bfc14d54897f5ea405610b5e/users/f0d28cb4d974412488ec48c2ccde335c/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.270989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fef0c-3955-44ee-a251-e5fe8219ac2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a4c561bfc14d54897f5ea405610b5e, user_id=f0d28cb4d974412488ec48c2ccde335c, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:03.272838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:03.273495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.273698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fef0c-3955-44ee-a251-e5fe8219ac2c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.273795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.274039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.275821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:03.284003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 933/1856] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:03 2022] PUT /identity/v3/projects/04a4c561bfc14d54897f5ea405610b5e/users/f0d28cb4d974412488ec48c2ccde335c/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:03.294087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.294373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.294650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.322084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] MFA Rules not processed for user `f0d28cb4d974412488ec48c2ccde335c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:03.323304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:03.346374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:03.347821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.357246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 924/1857] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:03.398272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 934/1858] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:10:03.413809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:03.415725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:03.429020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11f8a-4ccb-4fd4-96c4-100e6c2df6ab service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:03.499858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63115e2-4ece-410d-92ac-8f990ac11aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:03.500547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63115e2-4ece-410d-92ac-8f990ac11aff service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:03.500957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63115e2-4ece-410d-92ac-8f990ac11aff service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:03.501128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63115e2-4ece-410d-92ac-8f990ac11aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:03.512205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63115e2-4ece-410d-92ac-8f990ac11aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:03.513783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63115e2-4ece-410d-92ac-8f990ac11aff service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:03.527221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 925/1859] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:04.277910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:04.346500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb2e04-087c-43c5-8e51-85669d2b7f52 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:04.351037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:04.351910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:04.352200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:04.352481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] PATH_INFO: `/v3/users/308cda3ae27945e9867d873bf3580767` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:04.353708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=308cda3ae27945e9867d873bf3580767)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:04.355659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:04.399065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:04.414065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308cda3ae27945e9867d873bf3580767'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:04.421886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308cda3ae27945e9867d873bf3580767'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:04.422547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308cda3ae27945e9867d873bf3580767'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:04.436604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308cda3ae27945e9867d873bf3580767'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:04.444041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308cda3ae27945e9867d873bf3580767'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:04.450259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 935/1860] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:04 2022] DELETE /identity/v3/users/308cda3ae27945e9867d873bf3580767 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:04.455842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:04.456339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:04.456427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:04.475543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:04.476401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:04.520772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:04.544340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 926/1861] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:04.554336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:04.555895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:04.651338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187a41-6749-4f61-a352-1c58cf4f2abc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:04.655132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e12f7-7f62-4523-a5e6-c577b47e7c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:04.655854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e12f7-7f62-4523-a5e6-c577b47e7c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:04.656148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e12f7-7f62-4523-a5e6-c577b47e7c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:04.656424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e12f7-7f62-4523-a5e6-c577b47e7c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:04.670797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e12f7-7f62-4523-a5e6-c577b47e7c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:04.677728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e12f7-7f62-4523-a5e6-c577b47e7c3c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:04.691338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 936/1862] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:05.490361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:05.492002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:05.506159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ae585-0658-446a-a1bd-ecd88d4d6885 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:05.512073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:05.513203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:05.513762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:05.514191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] PATH_INFO: `/v3/users/76947bc0a8284e56a1c500f956ddb9f4` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:05.515742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76947bc0a8284e56a1c500f956ddb9f4)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:05.518823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:05.577877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76947bc0a8284e56a1c500f956ddb9f4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.579640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76947bc0a8284e56a1c500f956ddb9f4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.581887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76947bc0a8284e56a1c500f956ddb9f4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.600077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76947bc0a8284e56a1c500f956ddb9f4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.608166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76947bc0a8284e56a1c500f956ddb9f4'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.624668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 927/1863] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:05 2022] DELETE /identity/v3/users/76947bc0a8284e56a1c500f956ddb9f4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:05.630864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:05.632441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:05.632941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:05.655475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:05.656840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:05.729425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 937/1864] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:05.743155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:05.744582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:05.746880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:05.753848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:05.766978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ec2c7-25bc-4d1a-9521-37304c2e185d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:05.772397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:05.774076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:05.774288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:05.774573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] PATH_INFO: `/v3/projects/c5592e7ef53b487088cf4e06107c544e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:05.775821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5592e7ef53b487088cf4e06107c544e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:05.778668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:05.839330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5592e7ef53b487088cf4e06107c544e', 'request_id': 'req-60302d77-458f-47f7-81c0-b12d96997805'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.846021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855793-26e9-4934-8e8a-b888e15f0436 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:05.846166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:05.847499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5592e7ef53b487088cf4e06107c544e', 'request_id': 'req-60302d77-458f-47f7-81c0-b12d96997805'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.856434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5592e7ef53b487088cf4e06107c544e', 'request_id': 'req-60302d77-458f-47f7-81c0-b12d96997805'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.873188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] The token cache is being invalidate because project c5592e7ef53b487088cf4e06107c544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:05.873489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.874421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:05.877088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 938/1865] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:05 2022] DELETE /identity/v3/projects/c5592e7ef53b487088cf4e06107c544e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:05.880957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:05.882355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:05.935969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:05.936729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:05.937221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:05.937606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:05.941036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:05.965495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302d77-458f-47f7-81c0-b12d96997805 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:05.972133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:05.973058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:05.973341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:05.973618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] PATH_INFO: `/v3/users/f0d28cb4d974412488ec48c2ccde335c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:05.974956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d28cb4d974412488ec48c2ccde335c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:05.976914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:05.979246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:06.042113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:06.043747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:06.054370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d28cb4d974412488ec48c2ccde335c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.056712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 928/1866] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:06.065029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d28cb4d974412488ec48c2ccde335c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.065855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d28cb4d974412488ec48c2ccde335c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.080843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d28cb4d974412488ec48c2ccde335c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.090898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d28cb4d974412488ec48c2ccde335c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.099580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 939/1867] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:05 2022] DELETE /identity/v3/users/f0d28cb4d974412488ec48c2ccde335c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:06.576893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:06.593788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7e13-3bdb-48bf-99d7-eee70330b099 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:06.777919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:06.779664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:06.780050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:06.780485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] PATH_INFO: `/v3/projects/04a4c561bfc14d54897f5ea405610b5e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:06.784696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a4c561bfc14d54897f5ea405610b5e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:06.787409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:06.900731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a4c561bfc14d54897f5ea405610b5e', 'request_id': 'req-c85b0340-36bd-49eb-bded-d3bdf057f87e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.923455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:06.924665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a4c561bfc14d54897f5ea405610b5e', 'request_id': 'req-c85b0340-36bd-49eb-bded-d3bdf057f87e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.925270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:06.932721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a4c561bfc14d54897f5ea405610b5e', 'request_id': 'req-c85b0340-36bd-49eb-bded-d3bdf057f87e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.952458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415da00-e1e1-46ae-ac6b-b25933fcf149 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:06.961062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] The token cache is being invalidate because project 04a4c561bfc14d54897f5ea405610b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:06.961639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.962494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c85b0340-36bd-49eb-bded-d3bdf057f87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:06.964904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 929/1868] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:06 2022] DELETE /identity/v3/projects/04a4c561bfc14d54897f5ea405610b5e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:06.977836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9fca-1ade-4939-bdad-b78306449e6e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:06.978133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9fca-1ade-4939-bdad-b78306449e6e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:06.978416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9fca-1ade-4939-bdad-b78306449e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.027164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b21a9fca-1ade-4939-bdad-b78306449e6e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:07.028520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b21a9fca-1ade-4939-bdad-b78306449e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:07.124313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:07.150234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.151133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.151854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.152324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] PATH_INFO: `/v3/projects/4ad15499ceab4025a17be396e01248a9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.153695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad15499ceab4025a17be396e01248a9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.155637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.172583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 930/1869] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:07.174762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.175054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.175337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.176978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:07.235390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:07.235390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:07.256383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad15499ceab4025a17be396e01248a9', 'request_id': 'req-4e54324d-3a7a-4bd4-a04b-9c587996134f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.268663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad15499ceab4025a17be396e01248a9', 'request_id': 'req-4e54324d-3a7a-4bd4-a04b-9c587996134f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.280878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad15499ceab4025a17be396e01248a9', 'request_id': 'req-4e54324d-3a7a-4bd4-a04b-9c587996134f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.302633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] The token cache is being invalidate because project 4ad15499ceab4025a17be396e01248a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:07.303230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.304237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.311264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 940/1870] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:06 2022] DELETE /identity/v3/projects/4ad15499ceab4025a17be396e01248a9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:07.315786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:07.317467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:07.408749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 931/1871] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:07.411131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:07.421357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e89ac9-b212-4dfc-b686-4b5fc9354293 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:07.427141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.427724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.428548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.428548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.429055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:07.429388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.431015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.459424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 932/1872] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:07.461748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:07.477979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2580f1-ff2d-4a89-a098-00ce69889ea7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:07.500809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.504273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.505352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.507343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.508923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.516134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.519357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54324d-3a7a-4bd4-a04b-9c587996134f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:07.531047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.533253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.533604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.533933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] PATH_INFO: `/v3/users/e8f3e145d133479fb711ece7b3eddbb9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.537333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f3e145d133479fb711ece7b3eddbb9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.541458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.576801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 933/1873] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:07 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:07.579487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:07.661826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f3e145d133479fb711ece7b3eddbb9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.683182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f3e145d133479fb711ece7b3eddbb9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.684927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f3e145d133479fb711ece7b3eddbb9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.691004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dadce6-7fe1-4147-8509-8e9b3b1837a7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:07.697126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.697934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.698218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.699228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.699983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.702338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.717121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f3e145d133479fb711ece7b3eddbb9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.743229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 934/1874] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:07 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:07.744878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:07.746894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:07.748414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f3e145d133479fb711ece7b3eddbb9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:07.771801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bcecf-483b-4099-a220-9fe064e9b466 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:07.776339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 941/1875] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:07 2022] DELETE /identity/v3/users/e8f3e145d133479fb711ece7b3eddbb9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:07.881179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:07.901044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.902160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.902743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.903036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.905841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.910228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.925674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 935/1876] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:07.930284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:07.943119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038505a-7c58-4d98-9654-4b560060cc24 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:07.950130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af28a74-48be-4b15-b816-b8881bcd3ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:07.950899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af28a74-48be-4b15-b816-b8881bcd3ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:07.951563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af28a74-48be-4b15-b816-b8881bcd3ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:07.951803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af28a74-48be-4b15-b816-b8881bcd3ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:07.952851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af28a74-48be-4b15-b816-b8881bcd3ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:07.969204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af28a74-48be-4b15-b816-b8881bcd3ceb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:07.997969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:08.007006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 942/1877] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:08.014181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8fa8-1267-43a6-a369-47527b7a7aa3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:08.028190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:08.029739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.030105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.030459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] PATH_INFO: `/v3/projects/9a01b96fa22d4b4fab2b935fee78e1db/users/b88220177ab1472c99317f57c329a20c/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.052766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a01b96fa22d4b4fab2b935fee78e1db, user_id=b88220177ab1472c99317f57c329a20c, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:08.057698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:08.074780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 936/1878] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:07 2022] PUT /identity/v3/projects/9a01b96fa22d4b4fab2b935fee78e1db/users/b88220177ab1472c99317f57c329a20c/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:08.087698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.088003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.088347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.094872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:08.123138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] MFA Rules not processed for user `b88220177ab1472c99317f57c329a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:08.124420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:08.199306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 943/1879] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:08.211229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:08.213035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:08.280236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f9be7-3f02-4626-9ae2-5095ec6f0a28 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:08.284697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a543-c8b3-414a-bf87-b15437cbeb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:08.285368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a543-c8b3-414a-bf87-b15437cbeb1c service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.285800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a543-c8b3-414a-bf87-b15437cbeb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.286089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a543-c8b3-414a-bf87-b15437cbeb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.301953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a543-c8b3-414a-bf87-b15437cbeb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:08.303445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a543-c8b3-414a-bf87-b15437cbeb1c service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:08.314832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 937/1880] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:08.341596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:08.452545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb4a8-693f-45bd-8739-bec4ed0412a0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:08.457811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:08.458713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.459013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.460094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] PATH_INFO: `/v3/users/b88220177ab1472c99317f57c329a20c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.460925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88220177ab1472c99317f57c329a20c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:08.463529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:08.544519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88220177ab1472c99317f57c329a20c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.555967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88220177ab1472c99317f57c329a20c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.556626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88220177ab1472c99317f57c329a20c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.570959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88220177ab1472c99317f57c329a20c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.580477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88220177ab1472c99317f57c329a20c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.589631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 944/1881] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:08 2022] DELETE /identity/v3/users/b88220177ab1472c99317f57c329a20c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:08.600713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.600713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.600713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.625574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:08.627242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:08.650598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:08.652387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:08.688394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:08.738734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 938/1882] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:08.739761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:08.742099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:08.761423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ffd96-4ccf-4e72-bda1-5c7a5ab293f5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:08.767713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:08.768585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.768898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.769178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] PATH_INFO: `/v3/projects/8281317e75034f3f95cfc73d794576f4` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.770592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8281317e75034f3f95cfc73d794576f4)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:08.772615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:08.788250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fad19-ed2a-484c-a545-f3bdd919ad2e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:08.793887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:08.794853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.795172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.795455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] PATH_INFO: `/v3/users/ecfc71bb018644ea967a5fdf98ce48c8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.796929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfc71bb018644ea967a5fdf98ce48c8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:08.800716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:08.854441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8281317e75034f3f95cfc73d794576f4', 'request_id': 'req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.865032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8281317e75034f3f95cfc73d794576f4', 'request_id': 'req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.868062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:08.878720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfc71bb018644ea967a5fdf98ce48c8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.887916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfc71bb018644ea967a5fdf98ce48c8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.889068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfc71bb018644ea967a5fdf98ce48c8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.889352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8281317e75034f3f95cfc73d794576f4', 'request_id': 'req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.905442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] The token cache is being invalidate because project 8281317e75034f3f95cfc73d794576f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:08.906072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.910570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.916111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 939/1883] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:08 2022] DELETE /identity/v3/projects/8281317e75034f3f95cfc73d794576f4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:08.917260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:08.918926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfc71bb018644ea967a5fdf98ce48c8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.919345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:08.928348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-43bd4ddd-f26a-4148-88af-d709be99e488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfc71bb018644ea967a5fdf98ce48c8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:08.943140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 945/1884] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:08 2022] DELETE /identity/v3/users/ecfc71bb018644ea967a5fdf98ce48c8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:08.947049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a056111-13d0-4392-975a-86e7e8dfc22b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:08.947469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a056111-13d0-4392-975a-86e7e8dfc22b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:08.947852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a056111-13d0-4392-975a-86e7e8dfc22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:08.978965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4a056111-13d0-4392-975a-86e7e8dfc22b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:08.980879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4a056111-13d0-4392-975a-86e7e8dfc22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.000269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93d3d-6a6d-48c4-aeba-09ebef56513f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.061998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 946/1885] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:09.069897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd7a7-7b00-4fee-8859-51014a99ad4c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.069897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd7a7-7b00-4fee-8859-51014a99ad4c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.069897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd7a7-7b00-4fee-8859-51014a99ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.085485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f7ffd7a7-7b00-4fee-8859-51014a99ad4c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:09.086977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f7ffd7a7-7b00-4fee-8859-51014a99ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.088266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.089018 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.089302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.089578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.091806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.097208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 947/1886] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:09.101981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2883-8769-4b91-bbda-467627110272 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.102377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2883-8769-4b91-bbda-467627110272 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.102759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2883-8769-4b91-bbda-467627110272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.114553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.117198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.122656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-18db2883-8769-4b91-bbda-467627110272 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:09.124128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-18db2883-8769-4b91-bbda-467627110272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.129984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 940/1887] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:09.130865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.139554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69faeb-301d-4364-af67-6b50efdc502b service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.140793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 948/1888] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:09.144504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.145193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.145481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.145807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.145931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2883-8769-4b91-bbda-467627110272 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.156516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.159198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.160187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2883-8769-4b91-bbda-467627110272 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.167394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.167805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.168072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.168351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.169291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:09.169605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.171532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.177344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 941/1889] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:09.189523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 949/1890] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:10:09.191467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.203175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444935f8-5870-4c4e-832f-c4d18bbf2828 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.210281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.211446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.211737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.212032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.212754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.214700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.249657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 942/1891] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:09.255092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.261485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:09.265745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600d00-c3e2-4b80-bf71-2f8709e5cfee admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.335383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.335999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.336268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.336548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.337297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.339463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.361101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 950/1892] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:09.365954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.386503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb1a3-bbf1-4ec9-8cf5-1004323c701c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.395096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.395865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.396258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.396601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.397446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.399472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.413161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 943/1893] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:09.417239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.429413 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbca304-5432-42a3-983a-44d2af130ba9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.436257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e17ff-9ebd-4788-8def-f1431c7bd6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.437124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e17ff-9ebd-4788-8def-f1431c7bd6cc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.437494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e17ff-9ebd-4788-8def-f1431c7bd6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.437851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e17ff-9ebd-4788-8def-f1431c7bd6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.438732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e17ff-9ebd-4788-8def-f1431c7bd6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.441265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e17ff-9ebd-4788-8def-f1431c7bd6cc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.454037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 951/1894] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:09.458486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.469772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13139e-0c9b-47e4-bae9-44b979b77c25 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.477965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.479211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.479342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.479730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] PATH_INFO: `/v3/projects/674cdc2e55d140bb9504fb738c2680c2/users/0410e76fa1aa4423885cbe7a784184fe/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.499752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674cdc2e55d140bb9504fb738c2680c2, user_id=0410e76fa1aa4423885cbe7a784184fe, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.503512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.522948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 944/1895] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:09 2022] PUT /identity/v3/projects/674cdc2e55d140bb9504fb738c2680c2/users/0410e76fa1aa4423885cbe7a784184fe/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:09.534075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.534572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.534883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.567304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] MFA Rules not processed for user `0410e76fa1aa4423885cbe7a784184fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:09.568655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.676044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 952/1896] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:09.681567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.734795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:09.758070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.760520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.774569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e20f48-bcec-4926-8c6a-c063ae76e326 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.779374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038cf4f-76eb-4e19-a666-45a35097476d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:09.781795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.783200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.783714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.784148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.785031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.787376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:09.788363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:09.788781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:09.789159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] PATH_INFO: `/v3/projects/9a01b96fa22d4b4fab2b935fee78e1db` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:09.789633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.792330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a01b96fa22d4b4fab2b935fee78e1db)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:09.794942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:09.847888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 945/1897] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:09.849296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.884216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a01b96fa22d4b4fab2b935fee78e1db', 'request_id': 'req-d6f5585c-3b40-42f1-8544-37dab588e285'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:09.902225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a01b96fa22d4b4fab2b935fee78e1db', 'request_id': 'req-d6f5585c-3b40-42f1-8544-37dab588e285'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:09.921154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a01b96fa22d4b4fab2b935fee78e1db', 'request_id': 'req-d6f5585c-3b40-42f1-8544-37dab588e285'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:09.927504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:09.945616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] The token cache is being invalidate because project 9a01b96fa22d4b4fab2b935fee78e1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:09.946297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:09.950190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:09.952665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 953/1898] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:09 2022] DELETE /identity/v3/projects/9a01b96fa22d4b4fab2b935fee78e1db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:09.958279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:09.960848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:09.974556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c728a-997c-4d56-9313-200f2f3908b0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.052143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5585c-3b40-42f1-8544-37dab588e285 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.057478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.057804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b40ec-83c9-4d4e-b144-0bdf6dc2fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.058505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.058628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b40ec-83c9-4d4e-b144-0bdf6dc2fc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.058915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.059007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b40ec-83c9-4d4e-b144-0bdf6dc2fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.059440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] PATH_INFO: `/v3/projects/346747cc0aa848488caaf14b20a4d735` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.059557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b40ec-83c9-4d4e-b144-0bdf6dc2fc83 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.060194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b40ec-83c9-4d4e-b144-0bdf6dc2fc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.060858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=346747cc0aa848488caaf14b20a4d735)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.062324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b40ec-83c9-4d4e-b144-0bdf6dc2fc83 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.062928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.091449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 946/1899] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:09 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:10.093727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.094256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.094576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.123974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:10.125969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.136075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346747cc0aa848488caaf14b20a4d735', 'request_id': 'req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.144402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346747cc0aa848488caaf14b20a4d735', 'request_id': 'req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.153950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346747cc0aa848488caaf14b20a4d735', 'request_id': 'req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.172244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] The token cache is being invalidate because project 346747cc0aa848488caaf14b20a4d735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:10.172630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.173557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.175330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 954/1900] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:09 2022] DELETE /identity/v3/projects/346747cc0aa848488caaf14b20a4d735 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:10.176558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.177723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.203204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:10.214639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 947/1901] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:10.222981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.224573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.238194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490c29-a823-4a50-aedc-7130c125a245 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.244357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.246031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.246320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.246964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] PATH_INFO: `/v3/users/03a004949a474b15922bc686a4f3f006` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.248283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a004949a474b15922bc686a4f3f006)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.250676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.271933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2b45-8f12-4d91-a3ef-c02c9ae7cf7a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.279262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1440d6f-7b26-44c2-9d79-9c53e2d4af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.279953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440d6f-7b26-44c2-9d79-9c53e2d4af7d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.280339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440d6f-7b26-44c2-9d79-9c53e2d4af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.281043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440d6f-7b26-44c2-9d79-9c53e2d4af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.281685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440d6f-7b26-44c2-9d79-9c53e2d4af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.284300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440d6f-7b26-44c2-9d79-9c53e2d4af7d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.299391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 955/1902] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:10.299391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.299391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.299391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.319480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:10.320745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.323585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a004949a474b15922bc686a4f3f006'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.324280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a004949a474b15922bc686a4f3f006'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.325113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a004949a474b15922bc686a4f3f006'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.333325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 956/1903] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:10.333325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.334647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.343946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a004949a474b15922bc686a4f3f006'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.347597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455923de-d6d9-40c2-9ae2-63dc891a7e90 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.352500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.352834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a004949a474b15922bc686a4f3f006'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:10.353606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.354647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.354647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] PATH_INFO: `/v3/projects/3174f0873fa84841a9f6e98da08ee132/users/bef4e478d92b403497796cd2fa78fe85/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.369442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:10.370181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 948/1904] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:10 2022] DELETE /identity/v3/users/03a004949a474b15922bc686a4f3f006 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:10.371547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.376175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3174f0873fa84841a9f6e98da08ee132, user_id=bef4e478d92b403497796cd2fa78fe85, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.379296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.403588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 957/1905] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:10 2022] PUT /identity/v3/projects/3174f0873fa84841a9f6e98da08ee132/users/bef4e478d92b403497796cd2fa78fe85/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:10.410105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.465303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd255ed-7672-4543-a9d5-d3cd87e30d2f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.498772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6401c-4019-4a90-b148-ec7c2cc71001 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.506142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.506890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.507185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.507564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.509225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.511070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.525336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 958/1906] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:10.529198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.540914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237780ea-4358-432e-900d-fc2f442c141c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.547503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.549589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.549879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.550160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] PATH_INFO: `/v3/projects/3174f0873fa84841a9f6e98da08ee132/users/bef4e478d92b403497796cd2fa78fe85/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.552499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3174f0873fa84841a9f6e98da08ee132, user_id=bef4e478d92b403497796cd2fa78fe85, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.555238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.555792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.556264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.556714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.557282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.558168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:10.558630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.560620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6841d-02c1-4158-9ba8-135fa8b8862a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.575128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 949/1908] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:10.575360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 959/1908] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:10 2022] PUT /identity/v3/projects/3174f0873fa84841a9f6e98da08ee132/users/bef4e478d92b403497796cd2fa78fe85/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:10.587015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.589100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.589560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.589984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.614320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:10.624953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] MFA Rules not processed for user `bef4e478d92b403497796cd2fa78fe85`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:10.626107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.684901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac288-9181-4e94-b914-9c2679027b64 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.692356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.693512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.693972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.695953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.697162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.699781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.736827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 950/1909] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:10.750224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.752827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.755200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 960/1910] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:10 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:10.758915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.827633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbf646-184a-45ff-821b-496cc6aa1cda None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.863732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ff49d-d2eb-4ea0-9221-72c048589f97 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.869101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.869991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.870430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.870717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.871420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.874991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.884384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:10.918648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 961/1911] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:10 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:10.918648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:10.920211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:10.943224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4a4d-398b-4e2a-ad7e-6eee9ec445ba admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:10.951796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.952885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.953311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.953761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] PATH_INFO: `/v3/projects/c14dcdd75c9f4f7e91f4820d3bd1fd21` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:10.955968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14dcdd75c9f4f7e91f4820d3bd1fd21)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:10.959531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:10.990155 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2f55c-a83e-4c01-888e-5ed64852b02f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:10.993324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f55c-a83e-4c01-888e-5ed64852b02f service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:10.993629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f55c-a83e-4c01-888e-5ed64852b02f service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:10.993914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f55c-a83e-4c01-888e-5ed64852b02f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.044956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14dcdd75c9f4f7e91f4820d3bd1fd21', 'request_id': 'req-f0d8bc80-fac5-4d26-9442-7042f9749fcd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:11.053431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14dcdd75c9f4f7e91f4820d3bd1fd21', 'request_id': 'req-f0d8bc80-fac5-4d26-9442-7042f9749fcd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:11.061551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14dcdd75c9f4f7e91f4820d3bd1fd21', 'request_id': 'req-f0d8bc80-fac5-4d26-9442-7042f9749fcd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:11.085662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] The token cache is being invalidate because project c14dcdd75c9f4f7e91f4820d3bd1fd21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:11.085957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:11.086630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:11.088832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 962/1912] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:10 2022] DELETE /identity/v3/projects/c14dcdd75c9f4f7e91f4820d3bd1fd21 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:11.089677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.091153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:11.097281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2f55c-a83e-4c01-888e-5ed64852b02f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.098916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2f55c-a83e-4c01-888e-5ed64852b02f service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.114303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 951/1913] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:11.118383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4829-4baa-4ffa-8c9e-282b2be8f2ee None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.118821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4829-4baa-4ffa-8c9e-282b2be8f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.119242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4829-4baa-4ffa-8c9e-282b2be8f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.131547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:11.145521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bddd4829-4baa-4ffa-8c9e-282b2be8f2ee None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:11.146931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bddd4829-4baa-4ffa-8c9e-282b2be8f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:11.259156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8bc80-fac5-4d26-9442-7042f9749fcd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.263715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 952/1914] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:11.265584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd358-e021-4080-9074-115c704e4a70 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.265880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd358-e021-4080-9074-115c704e4a70 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.266187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd358-e021-4080-9074-115c704e4a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.268827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.269745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.270030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.270911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.271860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.273909 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.295919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-840fd358-e021-4080-9074-115c704e4a70 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:11.297288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-840fd358-e021-4080-9074-115c704e4a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:11.297505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 963/1915] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:11.301782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.312625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb008fe-65e1-4943-84d2-93bbfadcd196 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.324236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.326319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.327141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.327859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.354193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.359524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.360051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 953/1916] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:11.366516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd358-e021-4080-9074-115c704e4a70 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.392837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd358-e021-4080-9074-115c704e4a70 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.393783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 964/1917] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:11.395285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.406202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.406892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.407182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.408481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.408481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:11.410027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.410839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.423433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84561051-49de-4604-8745-cbfcfef544bc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.431372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5dc6c-f747-44b0-a015-7af0bff2406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.432622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5dc6c-f747-44b0-a015-7af0bff2406b admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.433026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5dc6c-f747-44b0-a015-7af0bff2406b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.433294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5dc6c-f747-44b0-a015-7af0bff2406b admin admin] PATH_INFO: `/v3/projects/838c4e05b90341fabe8b75deec1cfb25/users/6d001e090df943e9bfe0fb2452879d27/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.451906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5dc6c-f747-44b0-a015-7af0bff2406b admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c4e05b90341fabe8b75deec1cfb25, user_id=6d001e090df943e9bfe0fb2452879d27, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.455670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5dc6c-f747-44b0-a015-7af0bff2406b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.464777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 954/1918] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:11.468966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.483726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 965/1919] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:11 2022] PUT /identity/v3/projects/838c4e05b90341fabe8b75deec1cfb25/users/6d001e090df943e9bfe0fb2452879d27/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:11.497335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922480f3-8d16-467b-b0b5-fedfceacc2d4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.503767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.504053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.506824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.568305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] MFA Rules not processed for user `6d001e090df943e9bfe0fb2452879d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:11.569881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:11.597293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:11.601782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.602473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.602759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.603036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.603737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.605733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.656874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 966/1920] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:11.661089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.687974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeec58e-2e56-4b6d-b117-0fc691a76c51 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.701552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.702237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.702523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.702800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.703756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 955/1921] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:11.708218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.709442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.710400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.770814 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 967/1922] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:11.775686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.839183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18346c0c-0cd1-4fe7-b982-e8eef11956a4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.853837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:11.911673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c44f-7e52-456b-a698-1808488c9f7a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.932473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.935200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:11.936387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.937182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.937182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.937676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.940855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:11.941812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.942534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:11.942833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:11.949397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:11.951737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:11.969767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 956/1923] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:11.970964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.973380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:11.985337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 968/1924] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:11 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:11.987455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:11.995217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c4ac-0d1e-4beb-86b1-ce90b25264ed admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:11.999376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b949-52e6-46cc-9517-ed3b73f97526 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.000536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.001729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.002019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.002988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] PATH_INFO: `/v3/users/0410e76fa1aa4423885cbe7a784184fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.004439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0410e76fa1aa4423885cbe7a784184fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.006521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.007133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.007987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.008550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.009131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.010032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.011874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.024384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 969/1925] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:12.025396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.037572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98fcd6-0767-430e-82f4-3e36bb1dafc5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.044926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.045783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.046135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.046833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.047474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.050225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.067121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 970/1926] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:12.067121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.076947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a9cf-7fe7-4e29-907d-a716c1eae7c8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.081110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0410e76fa1aa4423885cbe7a784184fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:12.082702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0410e76fa1aa4423885cbe7a784184fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:12.083310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.084263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.084548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.084814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0410e76fa1aa4423885cbe7a784184fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:12.084927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.085716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.087626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.102873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0410e76fa1aa4423885cbe7a784184fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:12.104891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 971/1927] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:12.105891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.107750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.123211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0410e76fa1aa4423885cbe7a784184fe'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:12.145105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67b87a-70fd-4de5-bb2a-4b42b692b418 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.150057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 957/1928] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:11 2022] DELETE /identity/v3/users/0410e76fa1aa4423885cbe7a784184fe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:12.151015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.156062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcdd7e-49c1-4a72-a824-5a07ca569f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.156062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcdd7e-49c1-4a72-a824-5a07ca569f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.156062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcdd7e-49c1-4a72-a824-5a07ca569f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.156062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcdd7e-49c1-4a72-a824-5a07ca569f36 admin admin] PATH_INFO: `/v3/projects/8cab01cef2c647d48f3dcdf3ac682d11/users/1e21f56e8f6244d2850adc9634eb79ea/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.157075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.174342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcdd7e-49c1-4a72-a824-5a07ca569f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cab01cef2c647d48f3dcdf3ac682d11, user_id=1e21f56e8f6244d2850adc9634eb79ea, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.177175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcdd7e-49c1-4a72-a824-5a07ca569f36 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.197671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 972/1929] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:12 2022] PUT /identity/v3/projects/8cab01cef2c647d48f3dcdf3ac682d11/users/1e21f56e8f6244d2850adc9634eb79ea/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:12.199689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.200222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.201111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.227552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:12.230171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.280746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:12.284024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d260e96-f071-4f3f-96ca-edef1cff4049 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.320142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:12.336978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 973/1930] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:12.341287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.352281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba32fd-40c9-4568-9f36-be97cd0891b0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.358926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.358926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.358926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.358926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.359694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.362411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.381175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 974/1931] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:12.382148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.385925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.402941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.404089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.404659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.405100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] PATH_INFO: `/v3/projects/9452c1c2439d4247ad9a4e7e7f0ba486/users/5afdfc7504694be8a8abc6fa07ed4e8f/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.492870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9452c1c2439d4247ad9a4e7e7f0ba486, user_id=5afdfc7504694be8a8abc6fa07ed4e8f, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.499531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.511064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80223-6e4f-4edb-ba3c-0978e3e24c27 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.515699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c8ff3-b47f-44a6-83f0-35394f680e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.516373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c8ff3-b47f-44a6-83f0-35394f680e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.517447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c8ff3-b47f-44a6-83f0-35394f680e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.517790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c8ff3-b47f-44a6-83f0-35394f680e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.527472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 958/1932] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:12 2022] PUT /identity/v3/projects/9452c1c2439d4247ad9a4e7e7f0ba486/users/5afdfc7504694be8a8abc6fa07ed4e8f/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:12.528409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.534051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c8ff3-b47f-44a6-83f0-35394f680e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.537199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c8ff3-b47f-44a6-83f0-35394f680e2a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.551612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 975/1933] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:12.553487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.553807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.554092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.575987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:12.577303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.619064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ebf91-1bea-45a5-9ccf-f039565c765f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.629479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832969-4d50-4e20-a2dc-0f3f6afa4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.631586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832969-4d50-4e20-a2dc-0f3f6afa4832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.632039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832969-4d50-4e20-a2dc-0f3f6afa4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.632466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832969-4d50-4e20-a2dc-0f3f6afa4832 admin admin] PATH_INFO: `/v3/projects/8cab01cef2c647d48f3dcdf3ac682d11/users/1e21f56e8f6244d2850adc9634eb79ea/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.635267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832969-4d50-4e20-a2dc-0f3f6afa4832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cab01cef2c647d48f3dcdf3ac682d11, user_id=1e21f56e8f6244d2850adc9634eb79ea, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:12.639318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832969-4d50-4e20-a2dc-0f3f6afa4832 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:12.662170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 976/1934] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:12.667138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 959/1935] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:12 2022] PUT /identity/v3/projects/8cab01cef2c647d48f3dcdf3ac682d11/users/1e21f56e8f6244d2850adc9634eb79ea/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:12.672633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.675477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.679678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.680038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.680387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.742399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] MFA Rules not processed for user `1e21f56e8f6244d2850adc9634eb79ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:12.743975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:12.790116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c3f90-9705-4512-8235-5a68d2d73c31 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:12.839665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:12.922772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 960/1936] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:12.929126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:12.929352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:12.929654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:12.930183 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:12.933969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:12.935568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:13.004476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:13.094619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ab43-47ac-49af-843d-78b26879f6bb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:13.095470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:13.097196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:13.107637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:13.109433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 977/1937] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:13.114729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:13.115126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:13.115730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:13.117974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:13.202773 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:13.204862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:13.229274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 961/1938] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:13.268811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:13.270301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:13.285074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4556-b3ab-43e2-8f57-2d2e9b0bbb3d service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:13.291438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:13.292503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:13.292892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:13.293271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] PATH_INFO: `/v3/projects/674cdc2e55d140bb9504fb738c2680c2` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:13.295364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=674cdc2e55d140bb9504fb738c2680c2)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:13.296806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:13.401517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674cdc2e55d140bb9504fb738c2680c2', 'request_id': 'req-b308f833-a2d2-4174-b684-538fbf63a2ae'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.411913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674cdc2e55d140bb9504fb738c2680c2', 'request_id': 'req-b308f833-a2d2-4174-b684-538fbf63a2ae'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.420165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674cdc2e55d140bb9504fb738c2680c2', 'request_id': 'req-b308f833-a2d2-4174-b684-538fbf63a2ae'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.444118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] The token cache is being invalidate because project 674cdc2e55d140bb9504fb738c2680c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:13.444335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.445105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.449834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 978/1939] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:13 2022] DELETE /identity/v3/projects/674cdc2e55d140bb9504fb738c2680c2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:13.452319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:13.485030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28d5b-ca3e-4a0e-874b-cf517870341b service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:13.624724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:13.625756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:13.627149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:13.627149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] PATH_INFO: `/v3/users/bef4e478d92b403497796cd2fa78fe85` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:13.628785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef4e478d92b403497796cd2fa78fe85)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:13.631790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:13.729584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef4e478d92b403497796cd2fa78fe85'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.731589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef4e478d92b403497796cd2fa78fe85'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.734476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef4e478d92b403497796cd2fa78fe85'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.770798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef4e478d92b403497796cd2fa78fe85'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.782772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a9574787-85c3-4303-9703-7831b189be61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef4e478d92b403497796cd2fa78fe85'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:13.812203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:13.835621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 962/1940] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:13 2022] DELETE /identity/v3/users/bef4e478d92b403497796cd2fa78fe85 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:14.325395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:14.327518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:14.346003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308f833-a2d2-4174-b684-538fbf63a2ae admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:14.413940 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:14.426890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:14.428414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:14.428823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:14.429525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] PATH_INFO: `/v3/projects/3174f0873fa84841a9f6e98da08ee132` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:14.438162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3174f0873fa84841a9f6e98da08ee132)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:14.441029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:14.510276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3174f0873fa84841a9f6e98da08ee132', 'request_id': 'req-e14952c7-b824-4722-a94f-c23711a6103c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:14.519830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3174f0873fa84841a9f6e98da08ee132', 'request_id': 'req-e14952c7-b824-4722-a94f-c23711a6103c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:14.528541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3174f0873fa84841a9f6e98da08ee132', 'request_id': 'req-e14952c7-b824-4722-a94f-c23711a6103c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:14.547494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] The token cache is being invalidate because project 3174f0873fa84841a9f6e98da08ee132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:14.547848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:14.549156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e14952c7-b824-4722-a94f-c23711a6103c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:14.554755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 979/1941] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:14 2022] DELETE /identity/v3/projects/3174f0873fa84841a9f6e98da08ee132 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:14.557081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:14.560604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:14.560985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:14.598169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:14.601680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:14.683749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:14.684114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:14.684465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:14.694038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 963/1942] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:14.705800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:14.707141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:14.716175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 980/1943] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:14.720636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:14.737003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e5690-8706-4149-816c-332c1ed08363 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:14.742982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:14.743714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:14.743989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:14.744372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:14.745152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:14.745541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:14.747312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:14.775660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:14.787136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5570f-11ac-476c-9d56-93aea7c93fb4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:14.787642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 964/1944] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:14.793041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76021e-6acb-484e-a2de-277946b22408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:14.793713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76021e-6acb-484e-a2de-277946b22408 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:14.793990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76021e-6acb-484e-a2de-277946b22408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:14.794269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76021e-6acb-484e-a2de-277946b22408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:14.795131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76021e-6acb-484e-a2de-277946b22408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:14.797307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76021e-6acb-484e-a2de-277946b22408 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:14.853809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 981/1945] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:14 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:14.858401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:14.874379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8312c-43d6-4d0a-9905-3489bdb29483 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:14.944138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:14.944422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:14.944744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:14.989889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] MFA Rules not processed for user `5afdfc7504694be8a8abc6fa07ed4e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:14.991108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:15.023118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.024510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.024887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.025174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.025886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.028755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.063608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 965/1946] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:14 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:15.068100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.095552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f5ba-e13f-44a0-9db8-b31e5545501e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.115444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.116793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.118070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.120047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.121054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.128721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.136004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 982/1947] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:10:15.158922 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 966/1948] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:15.160943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.177829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c6f20-0a5e-412e-b2e8-71f5efbf05de None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.179451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.184233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:15.190986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.191670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.191951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.192381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.203485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.210782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.245798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 983/1949] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:15.250478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.272749 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f83e59-f0c9-4de6-bc3a-a0075c336e2b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.287645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4d8c-35c5-41ed-bb14-f9da04282d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.288934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4d8c-35c5-41ed-bb14-f9da04282d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.289377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4d8c-35c5-41ed-bb14-f9da04282d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.289823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4d8c-35c5-41ed-bb14-f9da04282d00 admin admin] PATH_INFO: `/v3/projects/0a5856b0f542491ab6293041a093608c/users/79880b48bd7547cb84c8a1538812b1e9/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.330464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4d8c-35c5-41ed-bb14-f9da04282d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5856b0f542491ab6293041a093608c, user_id=79880b48bd7547cb84c8a1538812b1e9, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.333935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4d8c-35c5-41ed-bb14-f9da04282d00 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.355268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 984/1950] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:15 2022] PUT /identity/v3/projects/0a5856b0f542491ab6293041a093608c/users/79880b48bd7547cb84c8a1538812b1e9/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:15.368666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.369074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.369423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.373700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d9bc8-d7e2-4a3f-8df9-789ca4919494 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.423860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:15.445821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:15.462898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] MFA Rules not processed for user `79880b48bd7547cb84c8a1538812b1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:15.466423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:15.534632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.535452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.535841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.536296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.622184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.624628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.640223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 967/1951] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:15.641197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 985/1952] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:15.646102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.742080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1d9d1-5e80-4560-92df-ba57548f79e7 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.747648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.748466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.748889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.749382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.750095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.753192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.787650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 968/1953] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:15 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:15.791453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.812224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490d2e8-f5e2-4d88-8968-d36b35ec5f70 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.898066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.899312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.899535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.899802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.901022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.903205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:15.939471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 986/1954] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:15 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:15.943397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:15.963919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c5976-a7e5-48d6-8eed-bc8ed1fc968f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:15.974976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:15.976999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:15.984245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:15.984571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:15.986277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:15.990147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.018028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 969/1955] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:16.020642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.031977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8676d3-3cee-4f5c-883b-db730f50de71 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.037872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.039335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.039800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.040446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] PATH_INFO: `/v3/projects/f95e8853b4944aaeb685fe2bdfbbb306/users/034c7fd89d8442fda2145a8c3e7687fd/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.071586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95e8853b4944aaeb685fe2bdfbbb306, user_id=034c7fd89d8442fda2145a8c3e7687fd, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.074416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.093861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 987/1956] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:16 2022] PUT /identity/v3/projects/f95e8853b4944aaeb685fe2bdfbbb306/users/034c7fd89d8442fda2145a8c3e7687fd/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:16.097724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.108604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e82130-6605-4832-bdb2-62efc68047aa admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.177042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:16.192549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dc4e3-9e2f-4fca-b6c9-996b834e4a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.193263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dc4e3-9e2f-4fca-b6c9-996b834e4a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.193549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dc4e3-9e2f-4fca-b6c9-996b834e4a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.193827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dc4e3-9e2f-4fca-b6c9-996b834e4a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.194552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dc4e3-9e2f-4fca-b6c9-996b834e4a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.197108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dc4e3-9e2f-4fca-b6c9-996b834e4a86 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.210059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 970/1957] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:16.214218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.225275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e965-88c9-4657-aabc-db02505cf915 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.230428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.231381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.231671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.231950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] PATH_INFO: `/v3/projects/f95e8853b4944aaeb685fe2bdfbbb306/users/034c7fd89d8442fda2145a8c3e7687fd/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.233984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95e8853b4944aaeb685fe2bdfbbb306, user_id=034c7fd89d8442fda2145a8c3e7687fd, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.237394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.248616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 988/1958] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:16 2022] PUT /identity/v3/projects/f95e8853b4944aaeb685fe2bdfbbb306/users/034c7fd89d8442fda2145a8c3e7687fd/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:16.260412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.260821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.261095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.289498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] MFA Rules not processed for user `034c7fd89d8442fda2145a8c3e7687fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:16.290829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:16.355794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.362066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:16.372723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 971/1959] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:16.385445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.386842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:16.421841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:16.442774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed722-b484-49d7-ab1e-a44ad864d694 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.457957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831788-ee00-4414-9eb9-56536976c860 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.459242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.460223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.460658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.461077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.461433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.462047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] PATH_INFO: `/v3/users/6d001e090df943e9bfe0fb2452879d27` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.463370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d001e090df943e9bfe0fb2452879d27)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.465431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.465543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.465897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.478334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.479901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.493812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 972/1960] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:10:16.545124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d001e090df943e9bfe0fb2452879d27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.561140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d001e090df943e9bfe0fb2452879d27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.561891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d001e090df943e9bfe0fb2452879d27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.586360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d001e090df943e9bfe0fb2452879d27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.603687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.620371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad748-32d0-463c-8b92-3d5808322fac service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.621076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c59cf114-003d-4030-a284-d78f070f097e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d001e090df943e9bfe0fb2452879d27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.637448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.637448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.637448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.637448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] PATH_INFO: `/v3/users/79880b48bd7547cb84c8a1538812b1e9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.638213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 989/1961] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:16 2022] DELETE /identity/v3/users/6d001e090df943e9bfe0fb2452879d27 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:16.639481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.640218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.641134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=79880b48bd7547cb84c8a1538812b1e9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.642182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.645618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.692783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:16.694123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:16.745798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79880b48bd7547cb84c8a1538812b1e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.746807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79880b48bd7547cb84c8a1538812b1e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.748375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79880b48bd7547cb84c8a1538812b1e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.763740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79880b48bd7547cb84c8a1538812b1e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.769719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:16.774406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-83a30232-b69c-4812-929d-c041511dd7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79880b48bd7547cb84c8a1538812b1e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:16.794546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 973/1962] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:16 2022] DELETE /identity/v3/users/79880b48bd7547cb84c8a1538812b1e9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:16.799311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.800874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.804035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 990/1963] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:16.804163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.810891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.812360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:16.830322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:16.836345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:16.888150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8544f-f208-4283-a027-aaa0a22eb4c5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.914629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 974/1964] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:10:16.919617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:16.926208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:16.952447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5b6db-2e78-46ca-806f-deb8ccb2d93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.953270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b6db-2e78-46ca-806f-deb8ccb2d93a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.953617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b6db-2e78-46ca-806f-deb8ccb2d93a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.953960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b6db-2e78-46ca-806f-deb8ccb2d93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:16.965306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5b6db-2e78-46ca-806f-deb8ccb2d93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:16.966689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5b6db-2e78-46ca-806f-deb8ccb2d93a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:16.979404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 991/1965] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:16.994386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362cce-0ee8-4909-91d7-03d2355917f4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:16.998093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:16.998744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:16.999029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:16.999302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:17.010640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:17.012668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:17.025598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 975/1966] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:10:17.085795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:17.086089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:17.086366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:17.104444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] MFA Rules not processed for user `5afdfc7504694be8a8abc6fa07ed4e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:17.105789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:17.166901 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 992/1967] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:17.607420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:17.608909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:17.627761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27beaef-ee67-4c59-b35b-4b397e6fe4eb service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:17.634335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:17.635905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:17.636413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:17.637886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] PATH_INFO: `/v3/projects/838c4e05b90341fabe8b75deec1cfb25` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:17.654257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838c4e05b90341fabe8b75deec1cfb25)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:17.658744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:17.694837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:17.696284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:17.715568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004322-4154-4d2e-9f7f-8241ef058690 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:17.721115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:17.722241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:17.722528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:17.722802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] PATH_INFO: `/v3/users/83e111e4a0df4636ac9dc837f511e487` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:17.724135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e111e4a0df4636ac9dc837f511e487)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:17.726176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:17.748880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838c4e05b90341fabe8b75deec1cfb25', 'request_id': 'req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.759982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838c4e05b90341fabe8b75deec1cfb25', 'request_id': 'req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.773445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838c4e05b90341fabe8b75deec1cfb25', 'request_id': 'req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.788696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] The token cache is being invalidate because project 838c4e05b90341fabe8b75deec1cfb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:17.788947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.789795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.792986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 976/1968] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:17 2022] DELETE /identity/v3/projects/838c4e05b90341fabe8b75deec1cfb25 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:17.796892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:17.799111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:17.800435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e111e4a0df4636ac9dc837f511e487'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.810026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e111e4a0df4636ac9dc837f511e487'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.810937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e111e4a0df4636ac9dc837f511e487'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.832611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:17.838246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e111e4a0df4636ac9dc837f511e487'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.850531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e111e4a0df4636ac9dc837f511e487'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:17.859018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 993/1969] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:17 2022] DELETE /identity/v3/users/83e111e4a0df4636ac9dc837f511e487 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:17.904648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b5310-3c1f-4a98-a62e-cadf7703ffb7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:17.978556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:17.979463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:17.979748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:17.980020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] PATH_INFO: `/v3/users/1e21f56e8f6244d2850adc9634eb79ea` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:17.981316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e21f56e8f6244d2850adc9634eb79ea)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:17.983453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.053509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e21f56e8f6244d2850adc9634eb79ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.054514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e21f56e8f6244d2850adc9634eb79ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.055684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e21f56e8f6244d2850adc9634eb79ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.075395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e21f56e8f6244d2850adc9634eb79ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.086236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e21f56e8f6244d2850adc9634eb79ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.116109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 977/1970] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:17 2022] DELETE /identity/v3/users/1e21f56e8f6244d2850adc9634eb79ea => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:18.166032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.167638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.184925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e628cd6-ece2-4651-b28a-14c84a6a64b4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.224417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.227730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.327041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:18.331454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:18.348473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.349395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.349720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.349999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] PATH_INFO: `/v3/projects/23a454e276d3405a93a67513e1a12126` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.351271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a454e276d3405a93a67513e1a12126)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.353349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.365587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52224ae-616d-42f6-be10-a26d6bad7ad1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.370719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.371981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.372331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.372736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] PATH_INFO: `/v3/projects/0a5856b0f542491ab6293041a093608c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.374816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5856b0f542491ab6293041a093608c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.382519 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.424115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a454e276d3405a93a67513e1a12126', 'request_id': 'req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.431891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a454e276d3405a93a67513e1a12126', 'request_id': 'req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.441872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a454e276d3405a93a67513e1a12126', 'request_id': 'req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.463161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] The token cache is being invalidate because project 23a454e276d3405a93a67513e1a12126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:18.463576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.464339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a84fcac-4451-4f7b-9b38-69acc3e95ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.464705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5856b0f542491ab6293041a093608c', 'request_id': 'req-6f1566ef-2ba7-410f-9ab4-a023ae93115b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.466110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 994/1971] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:18 2022] DELETE /identity/v3/projects/23a454e276d3405a93a67513e1a12126 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:18.471780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.472153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.472834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.474729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5856b0f542491ab6293041a093608c', 'request_id': 'req-6f1566ef-2ba7-410f-9ab4-a023ae93115b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.482988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5856b0f542491ab6293041a093608c', 'request_id': 'req-6f1566ef-2ba7-410f-9ab4-a023ae93115b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.495833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] The token cache is being invalidate because project 0a5856b0f542491ab6293041a093608c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:18.496390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.497610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.499979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 978/1972] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:18 2022] DELETE /identity/v3/projects/0a5856b0f542491ab6293041a093608c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:18.500339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:18.502419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.505316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.507624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.604716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 995/1973] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:18.604716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.608224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.622997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1566ef-2ba7-410f-9ab4-a023ae93115b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.623971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0dcad-c1d8-48c3-b10b-472c41985a17 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.628733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.629640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.629764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.630093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.630441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] PATH_INFO: `/v3/users/034c7fd89d8442fda2145a8c3e7687fd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.630542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.630776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.631074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] PATH_INFO: `/v3/projects/8cab01cef2c647d48f3dcdf3ac682d11` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.632060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=034c7fd89d8442fda2145a8c3e7687fd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.632254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cab01cef2c647d48f3dcdf3ac682d11)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.634231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.634415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.698840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cab01cef2c647d48f3dcdf3ac682d11', 'request_id': 'req-934cd000-0147-4d6f-84eb-dad194f49540'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.699491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034c7fd89d8442fda2145a8c3e7687fd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.700133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034c7fd89d8442fda2145a8c3e7687fd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.700789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034c7fd89d8442fda2145a8c3e7687fd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.709104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cab01cef2c647d48f3dcdf3ac682d11', 'request_id': 'req-934cd000-0147-4d6f-84eb-dad194f49540'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.715263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034c7fd89d8442fda2145a8c3e7687fd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.716879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cab01cef2c647d48f3dcdf3ac682d11', 'request_id': 'req-934cd000-0147-4d6f-84eb-dad194f49540'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.722112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:18.724658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3fbc786a-c75c-4fd5-8fe1-0903bf26d431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034c7fd89d8442fda2145a8c3e7687fd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.734640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] The token cache is being invalidate because project 8cab01cef2c647d48f3dcdf3ac682d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:18.734982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.735741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-934cd000-0147-4d6f-84eb-dad194f49540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:18.737380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 996/1974] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:18 2022] DELETE /identity/v3/projects/8cab01cef2c647d48f3dcdf3ac682d11 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:18.738686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.738972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.739244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.741875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 979/1975] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:18 2022] DELETE /identity/v3/users/034c7fd89d8442fda2145a8c3e7687fd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:18.743169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16c3b-2977-4342-ac1a-69c96ee7993a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.743597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16c3b-2977-4342-ac1a-69c96ee7993a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.743968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16c3b-2977-4342-ac1a-69c96ee7993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.746707 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:18.764747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f4c16c3b-2977-4342-ac1a-69c96ee7993a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:18.765911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f4c16c3b-2977-4342-ac1a-69c96ee7993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.789846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:18.791009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.836793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 980/1976] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:18.846425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.846425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.846717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.871630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:18.873733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:18.887169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 981/1977] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:18.888539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.898606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d63f9-32ac-4bfc-89b6-101f9713107f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.909195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 997/1978] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:18.913387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.915651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.916329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.916612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.917236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.917677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:18.923804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77cd13-c138-4ba5-9b41-b2b857d3b3a0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.924885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.926716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.940483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.942537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.943990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.944984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.947380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:18.947938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.949844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.950093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 982/1979] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:18.951176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.966976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5a89-b058-468f-99d4-1384d6e4ff74 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.970927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 998/1980] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:10:18.975522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:18.978159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.979105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.980262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:18.982192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:18.983089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:18.988514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:18.991834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17554f1-0fe1-4340-962b-59e159a9fcab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:18.997948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:18.999032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:18.999502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.000486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.002017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.004851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.020077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 983/1981] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:18 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:19.025054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.044786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 999/1982] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:18 2022] POST /identity/v3/projects => generated 355 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:19.046356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.106403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafcb2f-a9b2-4876-99e7-334c99dbae20 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.122276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071313e-c872-43fd-8dd4-67637621b89b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.127762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.128441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.128755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.129037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.129738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.131723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.155693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1000/1983] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/users => generated 278 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:19.155693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.156957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.159650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:19.167338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.168121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.168618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.169280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.170190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.170569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f8f33-4b83-445f-8b50-b9be144be406 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.172147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.175582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.176431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.176765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.177041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] PATH_INFO: `/v3/projects/f95e8853b4944aaeb685fe2bdfbbb306` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.178203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95e8853b4944aaeb685fe2bdfbbb306)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.180123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.197470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 984/1984] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:19.197470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.205531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ede3-bca2-4fb3-a053-7b7919d99cce admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.210236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.211034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.211478 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.211788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.212514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.214165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.224557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 985/1985] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:19.225396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.233715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95e8853b4944aaeb685fe2bdfbbb306', 'request_id': 'req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:19.235068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac715e3-60a1-4dfb-8fd1-958da5350f5a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.236927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:19.241333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95e8853b4944aaeb685fe2bdfbbb306', 'request_id': 'req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:19.249450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95e8853b4944aaeb685fe2bdfbbb306', 'request_id': 'req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:19.263421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] The token cache is being invalidate because project f95e8853b4944aaeb685fe2bdfbbb306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:19.263705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:19.265170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:19.274577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1001/1986] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:19 2022] DELETE /identity/v3/projects/f95e8853b4944aaeb685fe2bdfbbb306 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:19.275769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.277205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.304084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16766c69-1c04-4ead-b3db-673e962f0ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.304797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766c69-1c04-4ead-b3db-673e962f0ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.305159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766c69-1c04-4ead-b3db-673e962f0ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.305497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766c69-1c04-4ead-b3db-673e962f0ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.306307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766c69-1c04-4ead-b3db-673e962f0ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.308110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766c69-1c04-4ead-b3db-673e962f0ef4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.327832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 986/1987] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:19.329803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.330184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.330468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.357339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:19.359538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.379325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 987/1988] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:19.382418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.385966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.387379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93b9f1-cfb5-4bfc-bd90-c9a3eb9a0717 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.395050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb72e4-de95-44e2-85e6-e5141f8f80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.395764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb72e4-de95-44e2-85e6-e5141f8f80f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.396047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb72e4-de95-44e2-85e6-e5141f8f80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.396369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb72e4-de95-44e2-85e6-e5141f8f80f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.397140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb72e4-de95-44e2-85e6-e5141f8f80f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.398764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb72e4-de95-44e2-85e6-e5141f8f80f9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.411171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12af4d1-ed77-42c7-8335-ecebc8fd67ab None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.417169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.417954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.418310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.418661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.419475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.420116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1002/1989] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:19.421340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.421552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.421846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.422124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.441449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 988/1990] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:19.442942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.449709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:19.451484 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.459831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92f9a-fa21-4175-b035-ec2bf18db301 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.465116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1003/1991] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:19.465964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.466092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.467177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.467651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.468248 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] PATH_INFO: `/v3/projects/29547c79d9904dd994768e61c77e46fa/users/d96ff61e6a044ed2a612255b31745ba5/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.487612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45693-fe05-4a9b-aed4-59a4fc168a1e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.493177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29547c79d9904dd994768e61c77e46fa, user_id=d96ff61e6a044ed2a612255b31745ba5, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.496434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.497856 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0302061-6a9d-4fd6-b44e-d14d435824e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.499812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0302061-6a9d-4fd6-b44e-d14d435824e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.500341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0302061-6a9d-4fd6-b44e-d14d435824e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.501195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0302061-6a9d-4fd6-b44e-d14d435824e6 admin admin] PATH_INFO: `/v3/projects/e0e6e45a526e4cada6e35138a87c2ab1/users/3672f07bf1fc4310afa60896b8cd8375/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.524129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 989/1992] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:19 2022] PUT /identity/v3/projects/29547c79d9904dd994768e61c77e46fa/users/d96ff61e6a044ed2a612255b31745ba5/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:19.524129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.524432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0302061-6a9d-4fd6-b44e-d14d435824e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e6e45a526e4cada6e35138a87c2ab1, user_id=3672f07bf1fc4310afa60896b8cd8375, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.525965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0302061-6a9d-4fd6-b44e-d14d435824e6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.572916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1004/1993] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:19 2022] PUT /identity/v3/projects/e0e6e45a526e4cada6e35138a87c2ab1/users/3672f07bf1fc4310afa60896b8cd8375/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:19.574774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6f574-40cc-4d0d-96fe-0911d515bdc3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.575146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6f574-40cc-4d0d-96fe-0911d515bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.575499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6f574-40cc-4d0d-96fe-0911d515bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.619912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-09c6f574-40cc-4d0d-96fe-0911d515bdc3 None None] MFA Rules not processed for user `d96ff61e6a044ed2a612255b31745ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:19.621462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-09c6f574-40cc-4d0d-96fe-0911d515bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.629361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efa6df-3182-4453-a141-a33937fb10a2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.675623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:19.717048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.717679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1005/1994] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:19.718056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.718056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.718219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.718301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.718383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.718383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.718542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:19.718542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.718542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.732057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 990/1995] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:19.732917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.745424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4bd6e-13bc-43a0-a0da-5c88f1de4230 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.746849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] MFA Rules not processed for user `3672f07bf1fc4310afa60896b8cd8375`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:19.748078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.750377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.751598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.751947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.752290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.753095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.755603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.781143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:19.791091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 991/1996] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:19.791091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.837561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1006/1997] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:19.838658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.850798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221586-cfce-45d7-8427-1f053f9c51bd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.867880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a8da-dd90-4583-bcc2-771edca6ded5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:19.874060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.874795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.875171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.875543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.876984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.879152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.915760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 992/1998] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:19.917540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.919815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:19.921625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:19.922306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:19.922588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:19.923464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:19.924724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:19.926810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:19.951736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1007/1999] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:19.952708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:19.966984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149956-3e1e-4772-b8e0-8abe89cb3ca4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.000650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6af47b-eca1-46e3-85cb-ec4beaf7ff5c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.011654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.012318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.012602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.012911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.044160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.044996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.045286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.045593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.046282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.048439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.068901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:20.073714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1008/2000] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:19 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:20.074435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.085779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3197-d0d7-4b4d-a0ef-10a2d6e77fb6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.088534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.090362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.090891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.091561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.091849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.092127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.093309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.094579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.102125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 993/2001] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:20.108563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1009/2002] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:20.109049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.109914 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.124016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d491-ff74-4111-adab-8f0c4d841529 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.125730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbc60d-c50b-4003-98e1-b8b1f4b98725 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.129260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.130041 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.130329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.131272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.131651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.134384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.135049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.136563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.137128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.137592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] PATH_INFO: `/v3/projects/309bd332e1744546ab739863c1a12a89/users/4f24281c154e4064896f7b455bf1d206/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.147775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 994/2003] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:20.152833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.160352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=309bd332e1744546ab739863c1a12a89, user_id=4f24281c154e4064896f7b455bf1d206, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.166258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.166787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045c731-3d74-4e20-96db-c1ed3e4be8c7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.172288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.173220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.173739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.174166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.175108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.176739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.185327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1010/2004] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:20 2022] PUT /identity/v3/projects/309bd332e1744546ab739863c1a12a89/users/4f24281c154e4064896f7b455bf1d206/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:20.189718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.193428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 995/2005] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:20.199417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.203515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:20.220369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b31223-4940-4438-8986-e7385ad18d7d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.278096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e876ac-95fd-404c-a6e0-42cb2a3bd43f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.287990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.295964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.296437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.296557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.297283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.300950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.315045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1011/2006] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:20.319910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.334605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc93f71-1527-48b2-aea2-40c00a7bcfa6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.340810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c959c-5243-40c0-b3ba-6afdd52fdc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.341464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fb6ca-dc58-4551-94b2-10d0449391ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.341664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c959c-5243-40c0-b3ba-6afdd52fdc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.341928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c959c-5243-40c0-b3ba-6afdd52fdc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.342276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c959c-5243-40c0-b3ba-6afdd52fdc77 admin admin] PATH_INFO: `/v3/projects/309bd332e1744546ab739863c1a12a89/users/4f24281c154e4064896f7b455bf1d206/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.345230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c959c-5243-40c0-b3ba-6afdd52fdc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309bd332e1744546ab739863c1a12a89, user_id=4f24281c154e4064896f7b455bf1d206, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.348086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c959c-5243-40c0-b3ba-6afdd52fdc77 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.348225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb6ca-dc58-4551-94b2-10d0449391ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.348565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb6ca-dc58-4551-94b2-10d0449391ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.348820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb6ca-dc58-4551-94b2-10d0449391ea admin admin] PATH_INFO: `/v3/projects/542e29b7a015406b815eb24db837c7ed/users/dd8a64107feb4025982493ed6fb667d2/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.361770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1012/2007] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:20 2022] PUT /identity/v3/projects/309bd332e1744546ab739863c1a12a89/users/4f24281c154e4064896f7b455bf1d206/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:20.370320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fb6ca-dc58-4551-94b2-10d0449391ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=542e29b7a015406b815eb24db837c7ed, user_id=dd8a64107feb4025982493ed6fb667d2, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.372400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.372741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.373023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.373402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fb6ca-dc58-4551-94b2-10d0449391ea admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.394488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 996/2008] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:20 2022] PUT /identity/v3/projects/542e29b7a015406b815eb24db837c7ed/users/dd8a64107feb4025982493ed6fb667d2/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:20.405803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.406095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.406370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.412847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] MFA Rules not processed for user `4f24281c154e4064896f7b455bf1d206`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:20.414820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:20.458169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] MFA Rules not processed for user `dd8a64107feb4025982493ed6fb667d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:20.460533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:20.531559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1013/2009] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:10:20.544298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.581850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 997/2010] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:10:20.588567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.634712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551694-23e3-4227-885a-e06ebfd2a914 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.639304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.640220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.641043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.641710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.660617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.660868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:20.663201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.685234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1014/2011] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:10:20.714898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b4bd3-c678-4edc-bdf0-9e0b56898515 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.720194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.721145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.721546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.721928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.722669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.724816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.756544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 998/2012] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:20 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:20.757787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.769595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888df648-2be3-40fe-9e79-667e4a3c8932 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.777208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.789754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:20.837340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.837568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851816dc-72f3-4743-af18-8c57d627196f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.838138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.838491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.838832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.839586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.841071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.841719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.841946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.842057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.842932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.866855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1015/2013] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:20 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:20.874078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.885606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b550c-23ca-4b64-b095-be3c91afbd9c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.891033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.892427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.892823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.893103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.893832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.895442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.908230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1016/2014] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:20.912806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.919506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.922595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.926399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6dd4-5bd4-4a4f-b5e2-e513ec00a2e7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:20.931640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:20.932722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:20.933019 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:20.933296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] PATH_INFO: `/v3/projects/11068d619efb46a5bca99805bc320b9e/users/9b2e9d554eae4ec99e03d67fe518ad3c/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:20.935263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 999/2015] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:10:20.951546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=11068d619efb46a5bca99805bc320b9e, user_id=9b2e9d554eae4ec99e03d67fe518ad3c, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:20.955017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:20.971759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1017/2016] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:20 2022] PUT /identity/v3/projects/11068d619efb46a5bca99805bc320b9e/users/9b2e9d554eae4ec99e03d67fe518ad3c/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:20.976937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:20.993532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f045-fbe1-431c-8be5-b3b325c93a59 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:21.073602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b218b-3ed0-44a2-8ba5-d67bbf2e4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:21.074245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b218b-3ed0-44a2-8ba5-d67bbf2e4324 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:21.074530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b218b-3ed0-44a2-8ba5-d67bbf2e4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:21.075042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b218b-3ed0-44a2-8ba5-d67bbf2e4324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:21.075799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b218b-3ed0-44a2-8ba5-d67bbf2e4324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:21.077881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b218b-3ed0-44a2-8ba5-d67bbf2e4324 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:21.095953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1000/2017] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:21.098363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:21.111612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1face-e74e-4538-954e-8082e51376ad admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:21.117296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:21.118790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:21.119146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:21.119432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] PATH_INFO: `/v3/projects/11068d619efb46a5bca99805bc320b9e/users/9b2e9d554eae4ec99e03d67fe518ad3c/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:21.122033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11068d619efb46a5bca99805bc320b9e, user_id=9b2e9d554eae4ec99e03d67fe518ad3c, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:21.126788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:21.139091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1018/2018] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:21 2022] PUT /identity/v3/projects/11068d619efb46a5bca99805bc320b9e/users/9b2e9d554eae4ec99e03d67fe518ad3c/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:21.155153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:21.155571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:21.158001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:21.184002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:21.188128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] MFA Rules not processed for user `9b2e9d554eae4ec99e03d67fe518ad3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:21.190495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:21.263397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1001/2019] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:21.275543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:21.363514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4de49-e94b-45d2-9d72-1beaec18cc3f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:21.367288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:21.368000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:21.368224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:21.368501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:21.378037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:21.379479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:21.389212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1019/2020] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:21.476727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:21.486861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126479-7f13-4638-ab8a-3982cdf4e95c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:21.490448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeef898-811e-4762-91ba-28094d416e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:21.491125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef898-811e-4762-91ba-28094d416e2e service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:21.491410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef898-811e-4762-91ba-28094d416e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:21.491686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef898-811e-4762-91ba-28094d416e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:21.553125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeef898-811e-4762-91ba-28094d416e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:21.554595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeef898-811e-4762-91ba-28094d416e2e service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:21.564358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1002/2021] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:21.871230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:21.941559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62603933-798f-4e0b-9266-d63954e2e35f service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:21.946223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:21.947245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:21.947525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:21.948790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] PATH_INFO: `/v3/users/dd8a64107feb4025982493ed6fb667d2` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:21.949437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8a64107feb4025982493ed6fb667d2)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:21.951556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:21.957620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:22.012221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8a64107feb4025982493ed6fb667d2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.020941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8a64107feb4025982493ed6fb667d2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.021605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8a64107feb4025982493ed6fb667d2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.039234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8a64107feb4025982493ed6fb667d2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.047667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8a64107feb4025982493ed6fb667d2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.055620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1020/2022] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:21 2022] DELETE /identity/v3/users/dd8a64107feb4025982493ed6fb667d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:22.060065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:22.060573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:22.060656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:22.081131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:22.082433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:22.166100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1003/2023] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:22.176842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:22.179634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:22.258068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef006d1f-1ec5-4d66-bb7e-7ce0ebd987e7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:22.263927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:22.264351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:22.264662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:22.272031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:22.281544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:22.284256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:22.296544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1021/2024] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:22.586439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:22.588102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:22.602192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4f0a4-a9e5-497d-ae3a-3f2fde80c7a3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:22.607727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:22.609193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:22.609193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:22.609628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] PATH_INFO: `/v3/projects/542e29b7a015406b815eb24db837c7ed` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:22.610761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] RBAC: Authorizing `identity:delete_project(project_id=542e29b7a015406b815eb24db837c7ed)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:22.613099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:22.650142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:22.664588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542e29b7a015406b815eb24db837c7ed', 'request_id': 'req-18206f3e-1216-4240-b17e-a8070b7723df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.671937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542e29b7a015406b815eb24db837c7ed', 'request_id': 'req-18206f3e-1216-4240-b17e-a8070b7723df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.679934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542e29b7a015406b815eb24db837c7ed', 'request_id': 'req-18206f3e-1216-4240-b17e-a8070b7723df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.690908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] The token cache is being invalidate because project 542e29b7a015406b815eb24db837c7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:22.691178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.691830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.693433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1004/2025] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:22 2022] DELETE /identity/v3/projects/542e29b7a015406b815eb24db837c7ed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:22.697431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:22.707928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368416fd-8723-4964-945b-699c61bf6590 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:22.763421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:22.764617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:22.764980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:22.765288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] PATH_INFO: `/v3/users/9b2e9d554eae4ec99e03d67fe518ad3c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:22.767124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2e9d554eae4ec99e03d67fe518ad3c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:22.769131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:22.797618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:22.818851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2e9d554eae4ec99e03d67fe518ad3c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.827252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2e9d554eae4ec99e03d67fe518ad3c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.827946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2e9d554eae4ec99e03d67fe518ad3c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.841292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2e9d554eae4ec99e03d67fe518ad3c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.848897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2e9d554eae4ec99e03d67fe518ad3c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:22.855137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1022/2026] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:22 2022] DELETE /identity/v3/users/9b2e9d554eae4ec99e03d67fe518ad3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:23.146056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:23.148623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:23.163531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18206f3e-1216-4240-b17e-a8070b7723df admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:23.232748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:23.233631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:23.233912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:23.234187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] PATH_INFO: `/v3/projects/11068d619efb46a5bca99805bc320b9e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:23.235988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11068d619efb46a5bca99805bc320b9e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:23.237915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:23.296537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11068d619efb46a5bca99805bc320b9e', 'request_id': 'req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.306913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11068d619efb46a5bca99805bc320b9e', 'request_id': 'req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.324983 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11068d619efb46a5bca99805bc320b9e', 'request_id': 'req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.337468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] The token cache is being invalidate because project 11068d619efb46a5bca99805bc320b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:23.337753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.338400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d8544c39-c78f-41d4-97e1-0e1460c3c7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.340046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1005/2027] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:23 2022] DELETE /identity/v3/projects/11068d619efb46a5bca99805bc320b9e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:23.420059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:23.421892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:23.441380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecfcac-b2c5-4895-bca8-ab2a1a615cca admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:23.516964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:23.517961 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:23.518317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:23.518690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] PATH_INFO: `/v3/users/3672f07bf1fc4310afa60896b8cd8375` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:23.520713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3672f07bf1fc4310afa60896b8cd8375)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:23.522211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:23.575738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3672f07bf1fc4310afa60896b8cd8375'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.582993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3672f07bf1fc4310afa60896b8cd8375'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.583743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3672f07bf1fc4310afa60896b8cd8375'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.596900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3672f07bf1fc4310afa60896b8cd8375'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.604668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3672f07bf1fc4310afa60896b8cd8375'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:23.613066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1023/2028] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:23 2022] DELETE /identity/v3/users/3672f07bf1fc4310afa60896b8cd8375 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:23.617891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:23.618181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:23.618461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:23.637798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:23.639009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:23.703699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:23.721007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1006/2029] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:23.731205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:23.732727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:23.772162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:23.807142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc8d1-d6b6-46ac-a091-5a70eedb08a5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:23.810806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12eb4-d28f-4c03-bd82-52498d6f0b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:23.811456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12eb4-d28f-4c03-bd82-52498d6f0b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:23.811738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12eb4-d28f-4c03-bd82-52498d6f0b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:23.812009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12eb4-d28f-4c03-bd82-52498d6f0b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:23.821660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b12eb4-d28f-4c03-bd82-52498d6f0b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:23.823108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b12eb4-d28f-4c03-bd82-52498d6f0b16 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:23.833342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1024/2030] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:24.099531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.101262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:24.121299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a496fb-a72d-41ae-b7a1-7b27c83b539d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.127975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.128881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.129169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.129450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] PATH_INFO: `/v3/projects/e0e6e45a526e4cada6e35138a87c2ab1` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.130648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e6e45a526e4cada6e35138a87c2ab1)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.132579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.182166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e6e45a526e4cada6e35138a87c2ab1', 'request_id': 'req-1262d6c2-ee60-49d3-9737-0f044f1a2064'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:24.190842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e6e45a526e4cada6e35138a87c2ab1', 'request_id': 'req-1262d6c2-ee60-49d3-9737-0f044f1a2064'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:24.197939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e6e45a526e4cada6e35138a87c2ab1', 'request_id': 'req-1262d6c2-ee60-49d3-9737-0f044f1a2064'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:24.209587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] The token cache is being invalidate because project e0e6e45a526e4cada6e35138a87c2ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:24.209875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:24.211457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1262d6c2-ee60-49d3-9737-0f044f1a2064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:24.213038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1007/2031] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:24 2022] DELETE /identity/v3/projects/e0e6e45a526e4cada6e35138a87c2ab1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:24.218038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.218338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.218618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.237622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:24.238743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:24.301324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1025/2032] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:24.308808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.309097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.309375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.329050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:24.330343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:24.340410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1008/2033] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:24.346408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.362300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975af66-c6d6-4fd4-b30a-50779433c438 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.367158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.367817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.368100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.368376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.369227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:24.369543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.371140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.383904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1026/2034] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:24.387998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.398080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639107-f731-4a6a-b7fc-d7e0e3b6b3a4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.402820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.403526 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.403805 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.404082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.404826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.406762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.441055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1009/2035] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:24.445442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.455885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8802-fe0c-4f4d-86cf-0e048804c9bc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.515264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.515862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.516145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.517565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.518270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.520246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.539895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1027/2036] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:24.544179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.554505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea2b3-0368-44bf-bc29-7a41845c92cf admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.559295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.559952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.560238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.560517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.561285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.562906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.573446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1010/2037] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:24.577421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.588337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a76ed-6ed8-453f-8926-960e2a51a8a4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.593008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec3a9-2e5b-4d8a-969a-c8ccc80132c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.593661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec3a9-2e5b-4d8a-969a-c8ccc80132c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.593948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec3a9-2e5b-4d8a-969a-c8ccc80132c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.594234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec3a9-2e5b-4d8a-969a-c8ccc80132c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.595734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec3a9-2e5b-4d8a-969a-c8ccc80132c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.597423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec3a9-2e5b-4d8a-969a-c8ccc80132c4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.607304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1028/2038] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:24.611220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.620966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19736a14-699e-41d3-8c1b-3643ac9998c4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.625540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.626606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.626889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.627164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] PATH_INFO: `/v3/projects/e1e5ba69bb0545d0b8636dcd18fd1869/users/9b58ebe51362440c91847f94783619c6/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.642254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e5ba69bb0545d0b8636dcd18fd1869, user_id=9b58ebe51362440c91847f94783619c6, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.644961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.658907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1011/2039] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:24 2022] PUT /identity/v3/projects/e1e5ba69bb0545d0b8636dcd18fd1869/users/9b58ebe51362440c91847f94783619c6/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:24.669162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.669454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.669730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.705414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] MFA Rules not processed for user `9b58ebe51362440c91847f94783619c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:24.706665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:24.728178 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:24.781188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1029/2040] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:24.782799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.867172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d230d-73ca-4e2c-b5fa-beaba00b62f8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:24.873611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:24.874423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:24.874650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:24.874903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:24.876184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:24.878475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:24.894714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:24.912718 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1012/2041] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:24.916768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:24.933740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c08e8d-9fdd-4f74-b9b2-78e5c52863f0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.000163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.001779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.002140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.002491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.003307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.005442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.026785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1030/2042] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:24 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:25.030997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.042628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f583a-6478-4139-8c57-8e49993ec7e8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.047707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.048538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.048940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.049223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.050020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.051623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.065378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1013/2043] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:25.069570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.084860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170f06-9eea-4edb-bf5d-a8f35b5ffef8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.085957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397eb36-f3e2-4a9a-a883-6bf69ec7d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.086735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397eb36-f3e2-4a9a-a883-6bf69ec7d3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.087113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397eb36-f3e2-4a9a-a883-6bf69ec7d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.087455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397eb36-f3e2-4a9a-a883-6bf69ec7d3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.088309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397eb36-f3e2-4a9a-a883-6bf69ec7d3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.090071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397eb36-f3e2-4a9a-a883-6bf69ec7d3d3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.104190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1031/2044] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:25.105445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.115842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0b6a7-f2e3-4e4a-b91b-61668347b9b8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.120668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.121582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.121895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.122189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] PATH_INFO: `/v3/projects/77628cf5c9c2455388ced097d5b40ab3/users/c1be6414fac5420dafa04dec6dcf4f9b/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.138050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77628cf5c9c2455388ced097d5b40ab3, user_id=c1be6414fac5420dafa04dec6dcf4f9b, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.140807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.155717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1014/2045] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:25 2022] PUT /identity/v3/projects/77628cf5c9c2455388ced097d5b40ab3/users/c1be6414fac5420dafa04dec6dcf4f9b/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:25.167227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.167517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.167795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.195112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] MFA Rules not processed for user `c1be6414fac5420dafa04dec6dcf4f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:25.196323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:25.276083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1032/2046] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:25.280953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.358258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4267f-c18f-420f-b99f-b17f0290ea23 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.363927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.364704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.365057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.365399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.366657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.368424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.400744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1015/2047] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:25 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:25.402187 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.413675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bff85-3c76-4813-86c8-d56c5bda29b1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.445975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:25.480075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.480888 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.481246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.481609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.482397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.484396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.510360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1033/2048] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:25 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:25.515945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.538202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd358-6a74-4b07-b8aa-482e5f3efaa7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.542827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.543439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.543705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.543987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.544763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.547002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.559166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1016/2049] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:25.563164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.574097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957aa4-1b4e-4f73-8909-cb176bde107c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.580107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.581273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.581583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.581955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] PATH_INFO: `/v3/projects/917eaafa32714be18b400e272badbeea/users/16b0c21a500b48f1aceadf77bc5ddab0/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.598758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917eaafa32714be18b400e272badbeea, user_id=16b0c21a500b48f1aceadf77bc5ddab0, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.601848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.616426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1034/2050] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:25 2022] PUT /identity/v3/projects/917eaafa32714be18b400e272badbeea/users/16b0c21a500b48f1aceadf77bc5ddab0/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:25.620189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.631050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebceca-e183-4332-a44e-60a3a09e142b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.694160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4744349-101d-450d-912f-0f063bbf9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.694865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4744349-101d-450d-912f-0f063bbf9e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.695150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4744349-101d-450d-912f-0f063bbf9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.695433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4744349-101d-450d-912f-0f063bbf9e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.696162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4744349-101d-450d-912f-0f063bbf9e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.697807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4744349-101d-450d-912f-0f063bbf9e5a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.708749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1017/2051] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:25.713017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.723409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223bbb4-05f4-4a63-bd91-06d0ddc388a2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.728120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.729046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.729336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.729619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] PATH_INFO: `/v3/projects/917eaafa32714be18b400e272badbeea/users/16b0c21a500b48f1aceadf77bc5ddab0/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.731613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=917eaafa32714be18b400e272badbeea, user_id=16b0c21a500b48f1aceadf77bc5ddab0, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.734334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:25.744669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1035/2052] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:25 2022] PUT /identity/v3/projects/917eaafa32714be18b400e272badbeea/users/16b0c21a500b48f1aceadf77bc5ddab0/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:25.756266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.756636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.757028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.783989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] MFA Rules not processed for user `16b0c21a500b48f1aceadf77bc5ddab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:25.785286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:25.804839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:25.855263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1018/2053] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:25.866854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:25.868543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:25.927485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2e5c-3de8-4820-bc09-1f7e3f4e79ef admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:25.931111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:25.931743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:25.932027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:25.932303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:25.989881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:25.991318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:26.001628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1036/2054] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:27.489295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:27.491070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:27.506832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11461d3f-4580-4f2b-87ea-a4970b325433 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:27.510034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:27.510687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:27.510968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:27.511245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:27.577727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:27.579176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:27.588235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1019/2055] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:28.193725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:28.204208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383d89-c2a9-4037-96ff-8dc4f38f1476 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:28.212101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e1395-6cdc-4207-a83e-17eeff0dc526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:28.213510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e1395-6cdc-4207-a83e-17eeff0dc526 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:28.213795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e1395-6cdc-4207-a83e-17eeff0dc526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:28.214072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e1395-6cdc-4207-a83e-17eeff0dc526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:28.224748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e1395-6cdc-4207-a83e-17eeff0dc526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:28.226508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e1395-6cdc-4207-a83e-17eeff0dc526 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:28.237234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1037/2056] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:32.205711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:32.270311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802aae8-dced-4f61-887a-f588ccb10e20 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:32.275161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:32.276049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:32.276338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:32.276617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] PATH_INFO: `/v3/users/9b58ebe51362440c91847f94783619c6` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:32.277849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b58ebe51362440c91847f94783619c6)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:32.279819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:32.327331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b58ebe51362440c91847f94783619c6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:32.327991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b58ebe51362440c91847f94783619c6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:32.328605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b58ebe51362440c91847f94783619c6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:32.336489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:32.342607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b58ebe51362440c91847f94783619c6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:32.350676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b58ebe51362440c91847f94783619c6'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:32.363462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1020/2057] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:32 2022] DELETE /identity/v3/users/9b58ebe51362440c91847f94783619c6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:32.368166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:32.368618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:32.368777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:32.385975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:32.387170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:32.406689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:32.447211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1038/2058] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:32.457729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:32.459146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:32.521204 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625f3c3-4dbd-40f7-8b85-522b45bfa065 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:32.525703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:32.526354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:32.526637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:32.526910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:32.536448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:32.537945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:32.547353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1021/2059] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:33.120700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:33.123986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:33.137362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886aa91-5202-4d07-b6c2-566171bd9470 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:33.146489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:33.159691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:33.159691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:33.159691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] PATH_INFO: `/v3/projects/e1e5ba69bb0545d0b8636dcd18fd1869` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:33.162126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e5ba69bb0545d0b8636dcd18fd1869)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:33.166226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:33.247259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e5ba69bb0545d0b8636dcd18fd1869', 'request_id': 'req-85cc13ca-0492-40d1-9685-6c1ed519fb77'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.261008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e5ba69bb0545d0b8636dcd18fd1869', 'request_id': 'req-85cc13ca-0492-40d1-9685-6c1ed519fb77'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.275997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e5ba69bb0545d0b8636dcd18fd1869', 'request_id': 'req-85cc13ca-0492-40d1-9685-6c1ed519fb77'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.297479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] The token cache is being invalidate because project e1e5ba69bb0545d0b8636dcd18fd1869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:33.297789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.299837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.302329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1039/2060] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:33 2022] DELETE /identity/v3/projects/e1e5ba69bb0545d0b8636dcd18fd1869 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:33.306170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:33.318026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118127-4c6a-4290-b6ce-d3fa66ef37d3 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:33.382896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:33.383868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:33.384227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:33.384578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] PATH_INFO: `/v3/users/c1be6414fac5420dafa04dec6dcf4f9b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:33.386013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1be6414fac5420dafa04dec6dcf4f9b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:33.388168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:33.442274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1be6414fac5420dafa04dec6dcf4f9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.442948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1be6414fac5420dafa04dec6dcf4f9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.443568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1be6414fac5420dafa04dec6dcf4f9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.456177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1be6414fac5420dafa04dec6dcf4f9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.463354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1be6414fac5420dafa04dec6dcf4f9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.467127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:33.480716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1022/2061] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:33 2022] DELETE /identity/v3/users/c1be6414fac5420dafa04dec6dcf4f9b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:33.794953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:33.796754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:33.826764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc13ca-0492-40d1-9685-6c1ed519fb77 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:33.886147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:33.887016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:33.887308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:33.887587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] PATH_INFO: `/v3/projects/77628cf5c9c2455388ced097d5b40ab3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:33.888802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77628cf5c9c2455388ced097d5b40ab3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:33.890732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:33.937060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77628cf5c9c2455388ced097d5b40ab3', 'request_id': 'req-abdae64a-9695-4328-ba46-4d263ed11618'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.938213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:33.944588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77628cf5c9c2455388ced097d5b40ab3', 'request_id': 'req-abdae64a-9695-4328-ba46-4d263ed11618'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.952040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77628cf5c9c2455388ced097d5b40ab3', 'request_id': 'req-abdae64a-9695-4328-ba46-4d263ed11618'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.965482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] The token cache is being invalidate because project 77628cf5c9c2455388ced097d5b40ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:33.965778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.966414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-abdae64a-9695-4328-ba46-4d263ed11618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:33.968014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1040/2062] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:33 2022] DELETE /identity/v3/projects/77628cf5c9c2455388ced097d5b40ab3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:33.972059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:33.973895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:33.986721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461658d-ad10-4eda-ab6c-363646a97170 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:34.043134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:34.043999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.044279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.044547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] PATH_INFO: `/v3/users/16b0c21a500b48f1aceadf77bc5ddab0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.045757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b0c21a500b48f1aceadf77bc5ddab0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:34.047678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:34.094613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b0c21a500b48f1aceadf77bc5ddab0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.095286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b0c21a500b48f1aceadf77bc5ddab0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.095895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b0c21a500b48f1aceadf77bc5ddab0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.107736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b0c21a500b48f1aceadf77bc5ddab0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.114674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b0c21a500b48f1aceadf77bc5ddab0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.128497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1023/2063] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:33 2022] DELETE /identity/v3/users/16b0c21a500b48f1aceadf77bc5ddab0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:34.442577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ad0e-2847-4ab6-af73-391601164470 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.442942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ad0e-2847-4ab6-af73-391601164470 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.443292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ad0e-2847-4ab6-af73-391601164470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.464344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-44b4ad0e-2847-4ab6-af73-391601164470 None None] MFA Rules not processed for user `5afdfc7504694be8a8abc6fa07ed4e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:34.465892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-44b4ad0e-2847-4ab6-af73-391601164470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:34.505126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:34.507428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:34.555491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1041/2064] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:34.599973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d01caf-bc74-4150-a510-33c534871b59 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:34.604858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:34.606151 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.606439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.606722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] PATH_INFO: `/v3/projects/917eaafa32714be18b400e272badbeea` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.607935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=917eaafa32714be18b400e272badbeea)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:34.613319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:34.633516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:34.679306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917eaafa32714be18b400e272badbeea', 'request_id': 'req-f3108c56-dd5c-48ae-bfea-034bb2728bff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.692815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917eaafa32714be18b400e272badbeea', 'request_id': 'req-f3108c56-dd5c-48ae-bfea-034bb2728bff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.700189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917eaafa32714be18b400e272badbeea', 'request_id': 'req-f3108c56-dd5c-48ae-bfea-034bb2728bff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.714419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] The token cache is being invalidate because project 917eaafa32714be18b400e272badbeea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:34.714707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.715365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f3108c56-dd5c-48ae-bfea-034bb2728bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:34.717304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1024/2065] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:34 2022] DELETE /identity/v3/projects/917eaafa32714be18b400e272badbeea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:34.723257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.723671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.724043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.748798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:34.751899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:34.822983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1042/2066] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:34.831506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.832007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.832293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.850941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:34.852210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:34.860002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1025/2067] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:34.865074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:34.877472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257df22-d777-45c7-ad3b-3121d8597ab0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:34.882621 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:34.883329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.883648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.883921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.884655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:34.885008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:34.886686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:34.900550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1043/2068] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:34.905241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:34.916329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6c476-4e5e-44e4-9e05-a22320d1703c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:34.921369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:34.922027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:34.922302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:34.922570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:34.923415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:34.925538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:34.955986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1026/2069] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:34 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:34.960120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:34.971309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b57c9-c25d-4226-a13d-1ca8822da2af admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:35.037141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:35.037867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:35.038137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:35.038463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:35.039228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:35.041700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:35.059501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:35.065984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1044/2070] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:34 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:35.069881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:35.081777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651cef-289e-4b00-a684-956e765dc4f8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:35.086779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:35.087620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:35.087941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:35.088275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:35.089173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:35.090861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:35.103582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1027/2071] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:35.107926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:35.119308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea6f60-6085-43e1-a69b-6a1f452aeeca admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:35.124574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060640ac-ef2a-4ffb-9d60-0f4693d436f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:35.125324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060640ac-ef2a-4ffb-9d60-0f4693d436f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:35.125604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060640ac-ef2a-4ffb-9d60-0f4693d436f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:35.125880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060640ac-ef2a-4ffb-9d60-0f4693d436f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:35.127255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060640ac-ef2a-4ffb-9d60-0f4693d436f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:35.128907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060640ac-ef2a-4ffb-9d60-0f4693d436f5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:35.149907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1045/2072] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:35.153663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:35.164928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b3556-a41d-45cc-b86d-50c41fd4684d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:35.170707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:35.171713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:35.172068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:35.172474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] PATH_INFO: `/v3/projects/c77196a1a9a94eba8096e02075419ea5/users/7fba89474aa14b91a842a518c3de7530/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:35.190512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77196a1a9a94eba8096e02075419ea5, user_id=7fba89474aa14b91a842a518c3de7530, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:35.193445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:35.219647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1028/2073] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:35 2022] PUT /identity/v3/projects/c77196a1a9a94eba8096e02075419ea5/users/7fba89474aa14b91a842a518c3de7530/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:35.221959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:35.222258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:35.222540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:35.258209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] MFA Rules not processed for user `7fba89474aa14b91a842a518c3de7530`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:35.259423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:35.330633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1046/2074] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:35.342102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:35.343780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:35.407943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dbda8-9cce-4081-99ce-8e6ade44c793 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:35.412813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761149c9-1f72-4360-80b5-dd5a6bb3ae7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:35.413598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761149c9-1f72-4360-80b5-dd5a6bb3ae7f service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:35.413945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761149c9-1f72-4360-80b5-dd5a6bb3ae7f service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:35.414319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761149c9-1f72-4360-80b5-dd5a6bb3ae7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:35.424843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761149c9-1f72-4360-80b5-dd5a6bb3ae7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:35.426354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761149c9-1f72-4360-80b5-dd5a6bb3ae7f service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:35.435948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1029/2075] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:36.102824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:36.104336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:36.182283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bff08-e689-4a96-9645-56b003b7ad42 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:36.191017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:36.192601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:36.192922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:36.193203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] PATH_INFO: `/v3/users/d96ff61e6a044ed2a612255b31745ba5` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:36.194622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96ff61e6a044ed2a612255b31745ba5)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:36.196806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:36.281492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96ff61e6a044ed2a612255b31745ba5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:36.292338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96ff61e6a044ed2a612255b31745ba5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:36.293199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96ff61e6a044ed2a612255b31745ba5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:36.313476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96ff61e6a044ed2a612255b31745ba5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:36.322203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96ff61e6a044ed2a612255b31745ba5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:36.324263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:36.330874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1047/2076] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:36 2022] DELETE /identity/v3/users/d96ff61e6a044ed2a612255b31745ba5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:36.336189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:36.337261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:36.337571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:36.359381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:36.360720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:36.415491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:36.443716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1030/2077] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:36.453384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:36.455511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:36.522256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b74a63-880a-4fde-ab6b-95c789839dc7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:36.525851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:36.526494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:36.526776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:36.527052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:36.536415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:36.538170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:36.550941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1048/2078] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:37.060214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:37.061648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:37.073761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888bd60-4e32-4a5c-820a-435a4d22199b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:37.078254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:37.079152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:37.079686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:37.079686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] PATH_INFO: `/v3/projects/29547c79d9904dd994768e61c77e46fa` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:37.081068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29547c79d9904dd994768e61c77e46fa)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:37.082995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:37.136462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29547c79d9904dd994768e61c77e46fa', 'request_id': 'req-74f65cb5-ad3a-4da2-94c9-7e424e453d46'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.144071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29547c79d9904dd994768e61c77e46fa', 'request_id': 'req-74f65cb5-ad3a-4da2-94c9-7e424e453d46'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.151371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29547c79d9904dd994768e61c77e46fa', 'request_id': 'req-74f65cb5-ad3a-4da2-94c9-7e424e453d46'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.163801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] The token cache is being invalidate because project 29547c79d9904dd994768e61c77e46fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:37.164272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.165064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.177270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1031/2079] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:37 2022] DELETE /identity/v3/projects/29547c79d9904dd994768e61c77e46fa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:37.177416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:37.182304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89bea6-19e9-4f48-a198-a44576b938b3 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:37.243651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:37.244535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:37.244852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:37.245132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] PATH_INFO: `/v3/users/4f24281c154e4064896f7b455bf1d206` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:37.246334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f24281c154e4064896f7b455bf1d206)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:37.248264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:37.295917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f24281c154e4064896f7b455bf1d206'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.306565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f24281c154e4064896f7b455bf1d206'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.307156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f24281c154e4064896f7b455bf1d206'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.323012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f24281c154e4064896f7b455bf1d206'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.330657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-754eec3d-9b2b-4873-b1a5-a20712030644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f24281c154e4064896f7b455bf1d206'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:37.336946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1049/2080] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:37 2022] DELETE /identity/v3/users/4f24281c154e4064896f7b455bf1d206 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:37.828167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:37.830345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:37.843063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f65cb5-ad3a-4da2-94c9-7e424e453d46 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:37.945857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:37.946935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:37.947309 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:37.947592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] PATH_INFO: `/v3/projects/309bd332e1744546ab739863c1a12a89` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:37.948944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309bd332e1744546ab739863c1a12a89)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:37.950972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.025752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309bd332e1744546ab739863c1a12a89', 'request_id': 'req-0f76a476-c970-4d0b-b2ab-843f37ce1171'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:38.037231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309bd332e1744546ab739863c1a12a89', 'request_id': 'req-0f76a476-c970-4d0b-b2ab-843f37ce1171'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:38.047732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309bd332e1744546ab739863c1a12a89', 'request_id': 'req-0f76a476-c970-4d0b-b2ab-843f37ce1171'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:38.055813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:38.063186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] The token cache is being invalidate because project 309bd332e1744546ab739863c1a12a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:38.064431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:38.065371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0f76a476-c970-4d0b-b2ab-843f37ce1171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:38.070158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1032/2081] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:37 2022] DELETE /identity/v3/projects/309bd332e1744546ab739863c1a12a89 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:38.072622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.073284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.073698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.097415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:38.098737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:38.120462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:38.170689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1050/2082] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:38.178795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.179149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.179498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.198411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:38.199645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:38.208198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1033/2083] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:38.212652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.223220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54114d7-62c1-4ba4-bf23-1a4867bc4329 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.228534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.229526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.229933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.230105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.230870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:38.231212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.232968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.248513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1051/2084] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:38.252892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.262317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56556ec7-80e9-49ce-9b24-60adfa6770a8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.269223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.269895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.271842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.271842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.271842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.273085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.300165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1034/2085] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:38.303878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.314453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a189ec3-9a55-4dc4-8944-a0dd8a500b57 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.378420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.379143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.379571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.379855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.380601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.382591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.405852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1052/2086] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:38.409944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.420838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a608d40-c844-4c77-887e-c966de66b997 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.425797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.426499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.426760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.427016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.427758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.429434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.442304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1035/2087] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:38.446916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.458361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938e2e0-7213-4b6c-bad0-9a4432c30783 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.463319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ec1b-d092-48ec-a2e5-2ff806ec0446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.464005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ec1b-d092-48ec-a2e5-2ff806ec0446 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.464289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ec1b-d092-48ec-a2e5-2ff806ec0446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.464566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ec1b-d092-48ec-a2e5-2ff806ec0446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.465340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ec1b-d092-48ec-a2e5-2ff806ec0446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.467001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ec1b-d092-48ec-a2e5-2ff806ec0446 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.478981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1053/2088] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:38.483178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.493929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721210fa-13d9-4809-bb99-03bcf25b0b2c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.499142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.500227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.500515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.500825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] PATH_INFO: `/v3/projects/cfafc22e802e40aa926e3825e2ce2971/users/1ded0a93fb6349f3a89c11563c95cd62/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.520251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfafc22e802e40aa926e3825e2ce2971, user_id=1ded0a93fb6349f3a89c11563c95cd62, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.522990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.542728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1036/2089] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:38 2022] PUT /identity/v3/projects/cfafc22e802e40aa926e3825e2ce2971/users/1ded0a93fb6349f3a89c11563c95cd62/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:38.554098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21109cb8-1701-4946-8d03-368a5448721c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.554521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21109cb8-1701-4946-8d03-368a5448721c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.554830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21109cb8-1701-4946-8d03-368a5448721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.584336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-21109cb8-1701-4946-8d03-368a5448721c None None] MFA Rules not processed for user `1ded0a93fb6349f3a89c11563c95cd62`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:38.585568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-21109cb8-1701-4946-8d03-368a5448721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:38.654050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1054/2090] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:38.659104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.721451 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825a4b1-0311-41d1-8fa5-cccea79fa6d5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.726550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.727212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.727499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.727772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.728470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.730433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.768461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1037/2091] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:38.769631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21109cb8-1701-4946-8d03-368a5448721c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.780784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21109cb8-1701-4946-8d03-368a5448721c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.792778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:38.841307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.842010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.842293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.842567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.843286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.845266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.866539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1055/2092] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:38 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:38.870585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.881720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8606c-4bae-4ea3-a1f5-57d68ca6261a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.886381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.887028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.887308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.887581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.888321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.889957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.900348 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1038/2093] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:38.904486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.914939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798b88-a58e-43b4-9aac-eb3a26a0ea70 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:38.919582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:38.920494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:38.920825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:38.921095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] PATH_INFO: `/v3/projects/b12a784bc9c84caa8345cee86f6e663e/users/bb94b6d12e0c46cebb393cad1e4b5ed9/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:38.936261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12a784bc9c84caa8345cee86f6e663e, user_id=bb94b6d12e0c46cebb393cad1e4b5ed9, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:38.939905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:38.952408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1056/2094] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:38 2022] PUT /identity/v3/projects/b12a784bc9c84caa8345cee86f6e663e/users/bb94b6d12e0c46cebb393cad1e4b5ed9/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:38.956565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:38.967006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3ab5-b2fd-419d-87d7-2b0609621ebd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:39.026683 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe20d-f594-4dc4-a4e1-3c0ef4d296d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:39.027257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe20d-f594-4dc4-a4e1-3c0ef4d296d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:39.027544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe20d-f594-4dc4-a4e1-3c0ef4d296d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:39.027823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe20d-f594-4dc4-a4e1-3c0ef4d296d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:39.028551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe20d-f594-4dc4-a4e1-3c0ef4d296d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:39.030205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe20d-f594-4dc4-a4e1-3c0ef4d296d6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:39.040166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1039/2095] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:39.044221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:39.056099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0577ed-a90f-48a2-a23a-a51e010c2ede admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:39.060956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:39.061878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:39.062166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:39.062443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] PATH_INFO: `/v3/projects/b12a784bc9c84caa8345cee86f6e663e/users/bb94b6d12e0c46cebb393cad1e4b5ed9/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:39.065375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12a784bc9c84caa8345cee86f6e663e, user_id=bb94b6d12e0c46cebb393cad1e4b5ed9, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:39.068126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:39.080589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1057/2096] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:39 2022] PUT /identity/v3/projects/b12a784bc9c84caa8345cee86f6e663e/users/bb94b6d12e0c46cebb393cad1e4b5ed9/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:39.091247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:39.091538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:39.091825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:39.099934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:39.137567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] MFA Rules not processed for user `bb94b6d12e0c46cebb393cad1e4b5ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:39.139253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:39.228943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1040/2097] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:39.240311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:39.242109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:39.308543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d84f-14f2-4118-9cf9-995e2d9038c5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:39.312339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:39.313023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:39.313310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:39.314466 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:39.324241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:39.325957 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:39.336218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1058/2098] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:39.415126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:39.427883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0aed8-e372-42c3-a40b-7ca86f755ae4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:39.431704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec93f8-63a6-4e2b-966c-b217f9bdc597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:39.432384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec93f8-63a6-4e2b-966c-b217f9bdc597 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:39.432663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec93f8-63a6-4e2b-966c-b217f9bdc597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:39.432964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec93f8-63a6-4e2b-966c-b217f9bdc597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:39.489334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec93f8-63a6-4e2b-966c-b217f9bdc597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:39.490858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec93f8-63a6-4e2b-966c-b217f9bdc597 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:39.499999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1041/2099] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:42.210486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:42.285141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3065a-1299-45b6-bbdd-aabcb3db393f service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:42.289763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:42.290645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:42.291104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:42.291393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] PATH_INFO: `/v3/users/1ded0a93fb6349f3a89c11563c95cd62` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:42.292589 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ded0a93fb6349f3a89c11563c95cd62)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:42.294664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:42.308123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:42.347929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ded0a93fb6349f3a89c11563c95cd62'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:42.356711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ded0a93fb6349f3a89c11563c95cd62'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:42.357389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ded0a93fb6349f3a89c11563c95cd62'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:42.375000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ded0a93fb6349f3a89c11563c95cd62'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:42.393332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ded0a93fb6349f3a89c11563c95cd62'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:42.399795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1059/2100] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:42 2022] DELETE /identity/v3/users/1ded0a93fb6349f3a89c11563c95cd62 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:42.404212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:42.404731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:42.404823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:42.421760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:42.423090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:42.481563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1042/2101] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:42.491933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:42.493393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:42.551998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855f322-2a5c-4cd8-b982-9104835f6424 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:42.555740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:42.556377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:42.556657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:42.556965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:42.567216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:42.568967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:42.580860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1060/2102] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:42.924605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:42.926314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:42.940270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f15fb-ff40-4c5c-84ad-bcfda1de9dc7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:42.945193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:42.946366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:42.946645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:42.946918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] PATH_INFO: `/v3/projects/cfafc22e802e40aa926e3825e2ce2971` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:42.948196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfafc22e802e40aa926e3825e2ce2971)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:42.950225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:42.990056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:43.025507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfafc22e802e40aa926e3825e2ce2971', 'request_id': 'req-46b575f7-f268-46b5-8549-1f5dac80c5e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.035269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfafc22e802e40aa926e3825e2ce2971', 'request_id': 'req-46b575f7-f268-46b5-8549-1f5dac80c5e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.042927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfafc22e802e40aa926e3825e2ce2971', 'request_id': 'req-46b575f7-f268-46b5-8549-1f5dac80c5e7'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.054299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] The token cache is being invalidate because project cfafc22e802e40aa926e3825e2ce2971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:43.054589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.055245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.056827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1043/2103] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:42 2022] DELETE /identity/v3/projects/cfafc22e802e40aa926e3825e2ce2971 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:43.060907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:43.071034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f643f3-b316-4618-be0b-3b188de80920 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:43.128776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:43.129568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:43.129876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:43.130151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] PATH_INFO: `/v3/users/bb94b6d12e0c46cebb393cad1e4b5ed9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:43.131341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb94b6d12e0c46cebb393cad1e4b5ed9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:43.133318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:43.172915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:43.184737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb94b6d12e0c46cebb393cad1e4b5ed9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.192938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb94b6d12e0c46cebb393cad1e4b5ed9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.193632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb94b6d12e0c46cebb393cad1e4b5ed9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.206367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb94b6d12e0c46cebb393cad1e4b5ed9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.213305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb0e688f-1b45-42b6-8ebf-2d13f2f2cce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb94b6d12e0c46cebb393cad1e4b5ed9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.219704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1061/2104] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:43 2022] DELETE /identity/v3/users/bb94b6d12e0c46cebb393cad1e4b5ed9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:43.544236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:43.545857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:43.575587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b575f7-f268-46b5-8549-1f5dac80c5e7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:43.638846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:43.639642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:43.639930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:43.640199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] PATH_INFO: `/v3/projects/b12a784bc9c84caa8345cee86f6e663e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:43.641583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12a784bc9c84caa8345cee86f6e663e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:43.644716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:43.696659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12a784bc9c84caa8345cee86f6e663e', 'request_id': 'req-2f102504-e5f5-4c11-95ca-86900ecd6ace'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.705134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12a784bc9c84caa8345cee86f6e663e', 'request_id': 'req-2f102504-e5f5-4c11-95ca-86900ecd6ace'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.711635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12a784bc9c84caa8345cee86f6e663e', 'request_id': 'req-2f102504-e5f5-4c11-95ca-86900ecd6ace'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.722258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] The token cache is being invalidate because project b12a784bc9c84caa8345cee86f6e663e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:43.722543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.723181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2f102504-e5f5-4c11-95ca-86900ecd6ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:43.724744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1044/2105] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:43 2022] DELETE /identity/v3/projects/b12a784bc9c84caa8345cee86f6e663e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:43.730601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:43.730897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:43.731177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:43.748739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:43.750000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:43.814544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1062/2106] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:43.822165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:43.822459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:43.822743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:43.841398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:43.842602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:43.850568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1045/2107] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:43.854740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:43.869206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31e932-292d-4a09-ac6b-7db6c1463d90 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:43.876936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:43.877681 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:43.877984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:43.878293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:43.879112 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:43.879456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:43.881426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:43.899516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1063/2108] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:10:43.904360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:43.914071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddf2f7-5cbe-4a85-a6fc-f47fca589b06 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:43.918737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:43.919387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:43.919669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:43.919941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:43.920630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:43.922566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:43.952136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1046/2109] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:43 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:43.953629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:43.965428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb85b-9b52-4cd7-8f35-47eb1f03f4ca admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.029329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.030000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.030331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.030620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.031319 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.033338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.055318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1064/2110] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:43 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:44.058325 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.069415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7905a-817f-4454-ad10-c56460c4c73c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.074035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.074689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.074973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.075251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.075976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.077618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.088033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1047/2111] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:44.091836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.101700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808284-b275-420b-ba8b-b1c51d707197 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.106259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e5d27-e419-4f1e-8dae-1e3ba8d934e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.106899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e5d27-e419-4f1e-8dae-1e3ba8d934e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.107180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e5d27-e419-4f1e-8dae-1e3ba8d934e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.107453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e5d27-e419-4f1e-8dae-1e3ba8d934e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.108166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e5d27-e419-4f1e-8dae-1e3ba8d934e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.109858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e5d27-e419-4f1e-8dae-1e3ba8d934e2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.120083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1065/2112] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:44.124031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.130336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:44.136759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e46f8-dc84-4487-a297-6a61b23562f9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.143840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.144935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.145219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.145500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] PATH_INFO: `/v3/projects/25701149c0234676aa3d99b65b60c5c1/users/8d85fd66cf804fdaa448a396bd5df8dc/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.162208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25701149c0234676aa3d99b65b60c5c1, user_id=8d85fd66cf804fdaa448a396bd5df8dc, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.164873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.178626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1048/2113] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:44 2022] PUT /identity/v3/projects/25701149c0234676aa3d99b65b60c5c1/users/8d85fd66cf804fdaa448a396bd5df8dc/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:44.191214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.191503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.191791 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.218351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] MFA Rules not processed for user `8d85fd66cf804fdaa448a396bd5df8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:44.219604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:44.224846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:44.298854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1066/2114] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:44.303434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.370473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b924-f173-4a87-858d-db80a2d363f3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.375156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.375816 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.376652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.376965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.377664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.379590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.409169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1049/2115] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:44 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:44.413581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.433860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab3c9-cb23-4c8e-a480-2c0dcd49a834 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.495404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.496111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.496399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.496698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.497411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.499352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.520424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1067/2116] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:44 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:44.525262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.536614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80f6bb-af45-4459-92cc-54f713c75655 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.541326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.541982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.542268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.542554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.543280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.544960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.556783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1050/2117] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:44.561239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.572317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e58adb-b393-4cf1-85c6-56e7cda27bfd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.577078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.577990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.578278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.578559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] PATH_INFO: `/v3/projects/eb02c4b7300a4daaba1fc2cf15ee5f5b/users/1818e7359b4c402d9ef248f616b6443e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.595898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb02c4b7300a4daaba1fc2cf15ee5f5b, user_id=1818e7359b4c402d9ef248f616b6443e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.599181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.613864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1068/2118] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:44 2022] PUT /identity/v3/projects/eb02c4b7300a4daaba1fc2cf15ee5f5b/users/1818e7359b4c402d9ef248f616b6443e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:44.617945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.629535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d73d83-542e-45a1-b56d-d4388b356bc5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.698358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85d31f-7c2f-4487-86fb-342989a1176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.699200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d31f-7c2f-4487-86fb-342989a1176a admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.699585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d31f-7c2f-4487-86fb-342989a1176a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.700011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d31f-7c2f-4487-86fb-342989a1176a admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.700859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85d31f-7c2f-4487-86fb-342989a1176a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.702627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85d31f-7c2f-4487-86fb-342989a1176a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.716919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1051/2119] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:44.718106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.728097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000970c-07e8-4a66-aabc-6d773b4fcd8a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.732645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.733551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.733832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.734106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] PATH_INFO: `/v3/projects/eb02c4b7300a4daaba1fc2cf15ee5f5b/users/1818e7359b4c402d9ef248f616b6443e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.736699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb02c4b7300a4daaba1fc2cf15ee5f5b, user_id=1818e7359b4c402d9ef248f616b6443e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.739344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.750292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1069/2120] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:44 2022] PUT /identity/v3/projects/eb02c4b7300a4daaba1fc2cf15ee5f5b/users/1818e7359b4c402d9ef248f616b6443e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:44.760930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.761218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.761496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.791622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] MFA Rules not processed for user `1818e7359b4c402d9ef248f616b6443e`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:44.792868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:44.833210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:44.864153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1052/2121] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:44.874744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:44.877060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:44.946409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa31cd-0d29-4b00-a7d4-f93a85daf20e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:44.950480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:44.952487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:44.952487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:44.952487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:44.966963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:44.968403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:44.978975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1070/2122] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:45.091095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:45.101447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2de19a-9762-41a0-9b8a-6ce95447a6b8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:45.105162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2031a-fd38-4431-bb09-502e4d54affb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:45.105810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2031a-fd38-4431-bb09-502e4d54affb service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:45.106089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2031a-fd38-4431-bb09-502e4d54affb service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:45.106367 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2031a-fd38-4431-bb09-502e4d54affb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:45.168710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2031a-fd38-4431-bb09-502e4d54affb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:45.170172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2031a-fd38-4431-bb09-502e4d54affb service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:45.180077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1053/2123] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:47.841617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:47.845945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:47.914254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639493-e13b-41f7-a3fe-bcb2c5948b79 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:47.920536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:47.921686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:47.921972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:47.922271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] PATH_INFO: `/v3/users/8d85fd66cf804fdaa448a396bd5df8dc` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:47.924536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d85fd66cf804fdaa448a396bd5df8dc)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:47.926531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:47.983287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d85fd66cf804fdaa448a396bd5df8dc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:47.992490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d85fd66cf804fdaa448a396bd5df8dc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:47.993223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d85fd66cf804fdaa448a396bd5df8dc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.015246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d85fd66cf804fdaa448a396bd5df8dc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.023820 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d85fd66cf804fdaa448a396bd5df8dc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.030241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1071/2124] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:47 2022] DELETE /identity/v3/users/8d85fd66cf804fdaa448a396bd5df8dc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:48.036113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:48.036809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:48.036966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:48.057382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:48.058813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:48.163795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1054/2125] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:48.194479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:48.196921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:48.284711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c6b8-76cb-4b86-ad91-c3298f2e5197 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:48.286616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:48.287468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:48.287759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:48.288046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:48.299052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:48.300520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:48.310374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1072/2126] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:48.806693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:48.808403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:48.824716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc37954-5e1c-4b9b-8884-e8d787b577fe None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:48.831458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:48.832454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:48.833129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:48.833129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] PATH_INFO: `/v3/projects/25701149c0234676aa3d99b65b60c5c1` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:48.835052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25701149c0234676aa3d99b65b60c5c1)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:48.837647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:48.897310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25701149c0234676aa3d99b65b60c5c1', 'request_id': 'req-3cb206e0-4e77-460d-bb57-772aaa1aa30f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.909088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25701149c0234676aa3d99b65b60c5c1', 'request_id': 'req-3cb206e0-4e77-460d-bb57-772aaa1aa30f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.916867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25701149c0234676aa3d99b65b60c5c1', 'request_id': 'req-3cb206e0-4e77-460d-bb57-772aaa1aa30f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.922096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:48.931339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] The token cache is being invalidate because project 25701149c0234676aa3d99b65b60c5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:48.931962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.933194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:48.937133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1055/2127] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:48 2022] DELETE /identity/v3/projects/25701149c0234676aa3d99b65b60c5c1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:48.941250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:48.951480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7f08e-bbe9-4f93-a4b1-404bcca7851c service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:48.980171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:49.021328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.023057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.023057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.023057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] PATH_INFO: `/v3/users/1818e7359b4c402d9ef248f616b6443e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.024208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1818e7359b4c402d9ef248f616b6443e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.026776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.077172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1818e7359b4c402d9ef248f616b6443e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.085211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1818e7359b4c402d9ef248f616b6443e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.085846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1818e7359b4c402d9ef248f616b6443e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.100661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1818e7359b4c402d9ef248f616b6443e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.108797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a9a4ebb4-96e8-42b8-aeca-78d82dd96176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1818e7359b4c402d9ef248f616b6443e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.116711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1073/2128] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:48 2022] DELETE /identity/v3/users/1818e7359b4c402d9ef248f616b6443e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:49.463058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:49.464495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:49.482116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb206e0-4e77-460d-bb57-772aaa1aa30f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:49.547399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.548797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.549079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.549357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] PATH_INFO: `/v3/projects/eb02c4b7300a4daaba1fc2cf15ee5f5b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.550548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb02c4b7300a4daaba1fc2cf15ee5f5b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.552477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.599947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb02c4b7300a4daaba1fc2cf15ee5f5b', 'request_id': 'req-22af9c5e-c294-45cf-986a-ea9d794e8303'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.607291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb02c4b7300a4daaba1fc2cf15ee5f5b', 'request_id': 'req-22af9c5e-c294-45cf-986a-ea9d794e8303'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.614637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb02c4b7300a4daaba1fc2cf15ee5f5b', 'request_id': 'req-22af9c5e-c294-45cf-986a-ea9d794e8303'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.625452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] The token cache is being invalidate because project eb02c4b7300a4daaba1fc2cf15ee5f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:49.625727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.626887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-22af9c5e-c294-45cf-986a-ea9d794e8303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:49.628394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1056/2129] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:49 2022] DELETE /identity/v3/projects/eb02c4b7300a4daaba1fc2cf15ee5f5b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:49.633356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.633594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.633881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.651941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:49.653179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:49.715759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1074/2130] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:49.725200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.725571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.725912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.745110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:49.746312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:49.755171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1057/2131] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:49.759518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:49.769268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789db3f-b692-4bb8-9785-6a0f0b20c069 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:49.773827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.774468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.774751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.775028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.775748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:49.776054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.777684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.789556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1075/2132] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:49.793761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:49.803545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6e780-f44e-4167-8b19-6be47d998f62 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:49.808083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.808754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.809037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.809310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.809997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.811920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.836534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1058/2133] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:49.840554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:49.851090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41956d1-14e6-46cb-bfb5-d175c97bebf0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:49.879616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:49.908721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.909326 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.909607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.909877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.910682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.912605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.933037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1076/2134] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:49 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:49.937135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:49.947893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cca601-72bb-4feb-8d60-722fa19d8366 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:49.952647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.953326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.953608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.954386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.955114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.956774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.967110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1059/2135] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:49.971658 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:49.981719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320450-39b1-40db-a4f9-7e6fb61d4589 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:49.986266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f75c14-4f60-4157-b67e-b4d45e36359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:49.986915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f75c14-4f60-4157-b67e-b4d45e36359f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:49.987195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f75c14-4f60-4157-b67e-b4d45e36359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:49.987469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f75c14-4f60-4157-b67e-b4d45e36359f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:49.988181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f75c14-4f60-4157-b67e-b4d45e36359f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:49.989805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f75c14-4f60-4157-b67e-b4d45e36359f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:49.999830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1077/2136] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:50.003968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.014395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fb4b9-28d1-4f18-91bb-b6bfa4d8f051 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.019961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.020868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.021148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.021423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] PATH_INFO: `/v3/projects/7e5bd344ebad440ba7765c161fc7689f/users/67e2fce8a8d9465380f2a885c0ce2de0/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.038169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5bd344ebad440ba7765c161fc7689f, user_id=67e2fce8a8d9465380f2a885c0ce2de0, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.040930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.054315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1060/2137] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:50 2022] PUT /identity/v3/projects/7e5bd344ebad440ba7765c161fc7689f/users/67e2fce8a8d9465380f2a885c0ce2de0/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:50.064823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.065114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.065392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.093056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] MFA Rules not processed for user `67e2fce8a8d9465380f2a885c0ce2de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:50.094301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:50.160107 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1078/2138] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:50.164470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.189722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:50.228161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51723783-b719-42ed-8d65-4e13c5d938b4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.232857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.233513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.233795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.234073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.234771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.236777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.265590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1061/2139] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:50 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:50.267385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.278386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663027b1-1ab0-49bd-8552-59c4f6164f46 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.338091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.338774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.339061 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.339340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.340037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.342007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.362256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1079/2140] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:50 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:50.366100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.376914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591157-7e97-43b4-a191-2b4f6f11f920 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.381596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.382260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.382547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.382828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.383555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.385208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.396987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1062/2141] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:50.401219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.411723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfdd03-4c1c-4033-a731-376b5946fce5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.416250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.417162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.417441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.417709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] PATH_INFO: `/v3/projects/517234d86107460ab8d22da44434aeef/users/ea083957fb6140fbbeaf28174f8ceeb0/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.433251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=517234d86107460ab8d22da44434aeef, user_id=ea083957fb6140fbbeaf28174f8ceeb0, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.436077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.455029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:50.468091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1080/2142] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:50 2022] PUT /identity/v3/projects/517234d86107460ab8d22da44434aeef/users/ea083957fb6140fbbeaf28174f8ceeb0/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:50.472704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.483225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4aa62-d5d7-44fa-9bb8-1aabc4070918 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.586489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673422d-c37d-4ada-8ec3-7430c4caa419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.587170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673422d-c37d-4ada-8ec3-7430c4caa419 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.587452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673422d-c37d-4ada-8ec3-7430c4caa419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.587728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673422d-c37d-4ada-8ec3-7430c4caa419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.588454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673422d-c37d-4ada-8ec3-7430c4caa419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.590100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673422d-c37d-4ada-8ec3-7430c4caa419 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.603703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1063/2143] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:50.604979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.655554 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93919c6-fd08-4514-aefe-ba7436c24e3c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.661697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.662936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.663217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.663495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] PATH_INFO: `/v3/projects/517234d86107460ab8d22da44434aeef/users/ea083957fb6140fbbeaf28174f8ceeb0/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.665530 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517234d86107460ab8d22da44434aeef, user_id=ea083957fb6140fbbeaf28174f8ceeb0, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.668592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.680578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1081/2144] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:50 2022] PUT /identity/v3/projects/517234d86107460ab8d22da44434aeef/users/ea083957fb6140fbbeaf28174f8ceeb0/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:50.691281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.691573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.691853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.728330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] MFA Rules not processed for user `ea083957fb6140fbbeaf28174f8ceeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:50.729561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:50.759250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:50.799423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1064/2145] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:50.809974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:50.811693 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:50.885475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4e9b-a930-4a15-bbe5-4de0658ab8b8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:50.889145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada9ef4-f892-48f4-8716-e2452bf96fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:50.889779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9ef4-f892-48f4-8716-e2452bf96fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:50.890065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9ef4-f892-48f4-8716-e2452bf96fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:50.890344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9ef4-f892-48f4-8716-e2452bf96fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:50.899771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada9ef4-f892-48f4-8716-e2452bf96fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:50.901240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada9ef4-f892-48f4-8716-e2452bf96fe2 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:50.911140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1082/2146] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:51.039183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:51.101945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b50e-2fae-4693-920f-d3bbaccb998c None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:51.106485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:51.107359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:51.107654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:51.107927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] PATH_INFO: `/v3/users/67e2fce8a8d9465380f2a885c0ce2de0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:51.109143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e2fce8a8d9465380f2a885c0ce2de0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:51.111258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:51.161391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e2fce8a8d9465380f2a885c0ce2de0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.162238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e2fce8a8d9465380f2a885c0ce2de0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.162803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e2fce8a8d9465380f2a885c0ce2de0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.175749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e2fce8a8d9465380f2a885c0ce2de0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.183035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e2fce8a8d9465380f2a885c0ce2de0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.198695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1065/2147] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:51 2022] DELETE /identity/v3/users/67e2fce8a8d9465380f2a885c0ce2de0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:51.204925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:51.205423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:51.205579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:51.232268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:51.233513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:51.296049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1083/2148] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:51.305995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:51.307396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:51.364514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:51.398029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881285a-2e98-4970-a8ac-5abf31719e15 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:51.402434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:51.403314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:51.403809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:51.404206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:51.414603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:51.416142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:51.427164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1066/2149] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:51.763631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:51.765090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:51.777641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315138-7fa4-449a-aa4a-5128210ae06c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:51.783671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:51.783991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:51.784281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:51.784557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] PATH_INFO: `/v3/projects/7e5bd344ebad440ba7765c161fc7689f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:51.785854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5bd344ebad440ba7765c161fc7689f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:51.787745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:51.816655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:51.863080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5bd344ebad440ba7765c161fc7689f', 'request_id': 'req-bee0c485-fdda-4120-b691-9eb06da420ed'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.869429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5bd344ebad440ba7765c161fc7689f', 'request_id': 'req-bee0c485-fdda-4120-b691-9eb06da420ed'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.876840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5bd344ebad440ba7765c161fc7689f', 'request_id': 'req-bee0c485-fdda-4120-b691-9eb06da420ed'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.889044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] The token cache is being invalidate because project 7e5bd344ebad440ba7765c161fc7689f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:51.889329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.889939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:51.892715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1084/2150] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:51 2022] DELETE /identity/v3/projects/7e5bd344ebad440ba7765c161fc7689f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:51.896885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:51.906384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6037a6-924a-4079-a6f7-c1e8450c3702 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:51.962986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:51.963906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:51.964059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:51.964331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] PATH_INFO: `/v3/users/ea083957fb6140fbbeaf28174f8ceeb0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:51.965559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea083957fb6140fbbeaf28174f8ceeb0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:51.967484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.016490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea083957fb6140fbbeaf28174f8ceeb0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.017411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea083957fb6140fbbeaf28174f8ceeb0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.017917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea083957fb6140fbbeaf28174f8ceeb0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.030355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea083957fb6140fbbeaf28174f8ceeb0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.037655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e820a202-ba59-4f4b-a761-1b6957b23c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea083957fb6140fbbeaf28174f8ceeb0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.052381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1067/2151] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:51 2022] DELETE /identity/v3/users/ea083957fb6140fbbeaf28174f8ceeb0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:52.330377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.331928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:52.345627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0c485-fdda-4120-b691-9eb06da420ed admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.408958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.409809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.410092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.410365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] PATH_INFO: `/v3/projects/517234d86107460ab8d22da44434aeef` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.411528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517234d86107460ab8d22da44434aeef)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.413494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.461052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517234d86107460ab8d22da44434aeef', 'request_id': 'req-93aa49c1-e119-4fc1-8d92-17e94f4e1499'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.466375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517234d86107460ab8d22da44434aeef', 'request_id': 'req-93aa49c1-e119-4fc1-8d92-17e94f4e1499'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.474572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517234d86107460ab8d22da44434aeef', 'request_id': 'req-93aa49c1-e119-4fc1-8d92-17e94f4e1499'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.488044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] The token cache is being invalidate because project 517234d86107460ab8d22da44434aeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:52.488335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.488989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-93aa49c1-e119-4fc1-8d92-17e94f4e1499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:52.490570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1085/2152] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:52 2022] DELETE /identity/v3/projects/517234d86107460ab8d22da44434aeef => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:52.495659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.495972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.496250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.535083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:52.536220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:52.564429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:52.596575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1068/2153] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:52.605691 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.606009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.606292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.624444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:52.626248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:52.636102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1086/2154] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:52.643610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.653653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9ed2-1c90-402f-bdd6-581b9eb83a52 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.658334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.658988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.659269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.659540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.660259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:52.660566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.662240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.677070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1069/2155] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:10:52.680635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.693345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da190f-4ffb-4e6c-9bd2-f739b4447d7c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.698345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.699072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.699421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.699793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.700640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.702676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.730474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1087/2156] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:52 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:52.734442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.744418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e4cc2-c81f-47b5-8a2d-fda6b1168e53 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.804646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.805356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.805644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.805921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.806619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.808551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.831014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1070/2157] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:52 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:52.834624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.846722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c2ec-0e96-4585-9da5-a7369998da1c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.851624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.852441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.852861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.853237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.854059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.855945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.868580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1088/2158] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:52.872810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.886672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cc1cd-8788-4bac-9280-f67a615449b1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.894034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55974a29-5b2b-4a74-9943-04211fd10bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.894991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974a29-5b2b-4a74-9943-04211fd10bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.895379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974a29-5b2b-4a74-9943-04211fd10bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.895778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974a29-5b2b-4a74-9943-04211fd10bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.896978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974a29-5b2b-4a74-9943-04211fd10bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.898707 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974a29-5b2b-4a74-9943-04211fd10bb4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.915637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1071/2159] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:52.916795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:52.924950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:52.936622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d47229-afff-41fb-96f4-b30b6a63fb47 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:52.942676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:52.943731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.944016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.944294 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] PATH_INFO: `/v3/projects/d4c6f891366b4e09a89b5acc091fb3fc/users/f0ffd5d5704b46ecbcf245b8e6ec2c64/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:52.961475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c6f891366b4e09a89b5acc091fb3fc, user_id=f0ffd5d5704b46ecbcf245b8e6ec2c64, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:52.964217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:52.980300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1089/2160] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:52 2022] PUT /identity/v3/projects/d4c6f891366b4e09a89b5acc091fb3fc/users/f0ffd5d5704b46ecbcf245b8e6ec2c64/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:52.991968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:52.992266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:52.992577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.027019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] MFA Rules not processed for user `f0ffd5d5704b46ecbcf245b8e6ec2c64`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:53.028742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:53.109554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1072/2161] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:53.114805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.183314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127ae48-8c01-40b5-a74c-45f7b8451405 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.185885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.186549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.186834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.187113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.187803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.190735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.218403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1090/2162] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:53 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:53.222510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.233395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd79d8-5658-4072-b3e1-def9b87eadef None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.261601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:53.296931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.297925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.298211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.298497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.299198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.301167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.322145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1073/2163] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:53 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:10:53.326267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.337221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dac3f-9b8c-4cf8-809d-b47d793d3483 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.341779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.342430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.342713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.342985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.343702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.345603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.356349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1091/2164] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:53.360554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.371966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e462-9922-406e-a1a8-5ddc00dc15a7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.377382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.378270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.378558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.378837 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] PATH_INFO: `/v3/projects/e2f14599d50345b4b81553d46ac4a503/users/04b7fcade2be400fb3cd129adf7a30d7/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.398026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f14599d50345b4b81553d46ac4a503, user_id=04b7fcade2be400fb3cd129adf7a30d7, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.400781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.417982 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1074/2165] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:53 2022] PUT /identity/v3/projects/e2f14599d50345b4b81553d46ac4a503/users/04b7fcade2be400fb3cd129adf7a30d7/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:53.421775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.433983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f7b5f-afeb-44db-8c2b-b3d79c4c185e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.490280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a514f1-5240-4247-a1d8-241a099c492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.490937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a514f1-5240-4247-a1d8-241a099c492d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.491226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a514f1-5240-4247-a1d8-241a099c492d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.491501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a514f1-5240-4247-a1d8-241a099c492d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.492218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a514f1-5240-4247-a1d8-241a099c492d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.493846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a514f1-5240-4247-a1d8-241a099c492d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.505257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1092/2166] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:53.509949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.521437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c24c-c6c4-41ae-bfa4-35f4fabfc85e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.526045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.526925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.527203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.527477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] PATH_INFO: `/v3/projects/e2f14599d50345b4b81553d46ac4a503/users/04b7fcade2be400fb3cd129adf7a30d7/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.529474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f14599d50345b4b81553d46ac4a503, user_id=04b7fcade2be400fb3cd129adf7a30d7, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.532593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.542654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1075/2167] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:53 2022] PUT /identity/v3/projects/e2f14599d50345b4b81553d46ac4a503/users/04b7fcade2be400fb3cd129adf7a30d7/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:53.554181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.554483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.554763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.583206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] MFA Rules not processed for user `04b7fcade2be400fb3cd129adf7a30d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:53.584407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:53.622721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:53.654939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1093/2168] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:53.665407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:53.667094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:53.724242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e503e5a-1e89-4884-93ab-29fb217d077d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:53.727930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd369b92-8ac7-4022-ab90-11e609586d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:53.728573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd369b92-8ac7-4022-ab90-11e609586d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:53.728886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd369b92-8ac7-4022-ab90-11e609586d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:53.729162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd369b92-8ac7-4022-ab90-11e609586d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:53.741934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd369b92-8ac7-4022-ab90-11e609586d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:53.743376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd369b92-8ac7-4022-ab90-11e609586d03 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:53.753681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1076/2169] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:54.111619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:54.177008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79730cc-d968-4730-9c0f-73823d20a34d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:54.181630 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:54.182502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:54.182797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:54.183077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] PATH_INFO: `/v3/users/f0ffd5d5704b46ecbcf245b8e6ec2c64` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:54.184309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ffd5d5704b46ecbcf245b8e6ec2c64)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:54.186806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:54.238549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ffd5d5704b46ecbcf245b8e6ec2c64'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.245907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ffd5d5704b46ecbcf245b8e6ec2c64'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.246676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ffd5d5704b46ecbcf245b8e6ec2c64'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.258518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ffd5d5704b46ecbcf245b8e6ec2c64'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.265916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ffd5d5704b46ecbcf245b8e6ec2c64'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.272205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1094/2170] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:54 2022] DELETE /identity/v3/users/f0ffd5d5704b46ecbcf245b8e6ec2c64 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:10:54.276657 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:54.277188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:54.277289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:54.295704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:54.296956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:54.358412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1077/2171] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:54.368766 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:54.370283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:54.427760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b261-fe4e-4329-b313-7d7bccf48ee0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:54.431795 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:54.432034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:54.432322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:54.432600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:54.441867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:54.444948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:54.447509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:54.459819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1095/2172] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:54.737461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:54.739123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:54.754245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d08a1-f30a-420f-ab91-45537e47fa71 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:54.759260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:54.760164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:54.760407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:54.760742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] PATH_INFO: `/v3/projects/d4c6f891366b4e09a89b5acc091fb3fc` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:54.762104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c6f891366b4e09a89b5acc091fb3fc)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:54.763947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:54.786880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:54.813899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c6f891366b4e09a89b5acc091fb3fc', 'request_id': 'req-89611518-f889-457b-97c1-7803ce8c460c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.820954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c6f891366b4e09a89b5acc091fb3fc', 'request_id': 'req-89611518-f889-457b-97c1-7803ce8c460c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.827022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c6f891366b4e09a89b5acc091fb3fc', 'request_id': 'req-89611518-f889-457b-97c1-7803ce8c460c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.838059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] The token cache is being invalidate because project d4c6f891366b4e09a89b5acc091fb3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:54.838344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.838971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.840505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1078/2173] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:54 2022] DELETE /identity/v3/projects/d4c6f891366b4e09a89b5acc091fb3fc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:54.845257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:54.854840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692337-9a90-4ee3-937e-5c480d732583 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:54.913031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:54.913830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:54.914123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:54.914401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] PATH_INFO: `/v3/users/04b7fcade2be400fb3cd129adf7a30d7` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:54.915601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b7fcade2be400fb3cd129adf7a30d7)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:54.917580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:54.963027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b7fcade2be400fb3cd129adf7a30d7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.970150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b7fcade2be400fb3cd129adf7a30d7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.971043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b7fcade2be400fb3cd129adf7a30d7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.982774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b7fcade2be400fb3cd129adf7a30d7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.990273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8c84d977-7bc5-4894-8742-ed6eb5a5381c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b7fcade2be400fb3cd129adf7a30d7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:54.996384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1096/2174] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:10:54 2022] DELETE /identity/v3/users/04b7fcade2be400fb3cd129adf7a30d7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:55.270089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.271704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:55.295101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611518-f889-457b-97c1-7803ce8c460c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.357225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.358096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.358377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.358647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] PATH_INFO: `/v3/projects/e2f14599d50345b4b81553d46ac4a503` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.359947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f14599d50345b4b81553d46ac4a503)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.362372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.414446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f14599d50345b4b81553d46ac4a503', 'request_id': 'req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:55.422123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f14599d50345b4b81553d46ac4a503', 'request_id': 'req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:55.428860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f14599d50345b4b81553d46ac4a503', 'request_id': 'req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:55.439516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] The token cache is being invalidate because project e2f14599d50345b4b81553d46ac4a503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:10:55.439804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:55.440434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4d32d2c4-6e07-4194-9d07-cdd8e4d879ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:10:55.442047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1079/2175] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:10:55 2022] DELETE /identity/v3/projects/e2f14599d50345b4b81553d46ac4a503 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:55.446797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.447250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.447360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.471088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:55.472992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:55.534430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1097/2176] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:55.542297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.542588 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.542870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.560967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:55.562165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:55.570456 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1080/2177] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:55.574566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.584700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6901-fa8c-469d-8b06-b51df7a77f36 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.589228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.589867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.590147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.590420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.591129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:10:55.591432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.593039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.605014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1098/2178] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:10:55.609282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.618671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf210ce-9bcd-4827-ae00-13bb25faf074 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.623329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.623976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.624263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.624546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.625263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.627900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.661697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1081/2179] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:10:55 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:55.662835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.668014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:55.675261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586e00-4adf-455a-9271-9a3fc3d5bd0a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.734406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.735545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.735833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.736154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.736869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.738853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.758783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1099/2180] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:10:55 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:10:55.762949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.773988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fe6b-e6ec-4af5-a974-9877b51a97a1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.778623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.779277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.779561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.779839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.780597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.782411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.784534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:10:55.794472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1082/2181] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:10:55.798158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.808007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b289b7-3f96-4552-9362-f4c2268df321 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.812604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59954fd9-cd61-4c25-b335-bc0712615449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.814109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954fd9-cd61-4c25-b335-bc0712615449 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.814403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954fd9-cd61-4c25-b335-bc0712615449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.814651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954fd9-cd61-4c25-b335-bc0712615449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.815371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59954fd9-cd61-4c25-b335-bc0712615449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.816979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59954fd9-cd61-4c25-b335-bc0712615449 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.826863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1100/2182] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:10:55.831640 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.841474 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832d93-0dcd-4bba-a6a2-475de8c075c6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:55.846209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:55.847078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.847356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.847633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] PATH_INFO: `/v3/projects/17b652b31745445a9901d2a3b8732bf3/users/68fa6de58a444ecc8c1772a543c5bee0/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.861812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b652b31745445a9901d2a3b8732bf3, user_id=68fa6de58a444ecc8c1772a543c5bee0, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:55.864466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:55.878114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1083/2183] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:10:55 2022] PUT /identity/v3/projects/17b652b31745445a9901d2a3b8732bf3/users/68fa6de58a444ecc8c1772a543c5bee0/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:10:55.888060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704889-57b4-4915-a321-6f11f147fec2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:55.888404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704889-57b4-4915-a321-6f11f147fec2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:55.888711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704889-57b4-4915-a321-6f11f147fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:55.916370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ca704889-57b4-4915-a321-6f11f147fec2 None None] MFA Rules not processed for user `68fa6de58a444ecc8c1772a543c5bee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:55.917603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ca704889-57b4-4915-a321-6f11f147fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:55.981464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1101/2184] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:55.993411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:55.995068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:56.050687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17a6a-19cf-45b3-817a-86a7039ea652 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:56.054509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:56.054966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:56.055244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:56.055527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:56.065461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:56.066953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:56.075815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1084/2185] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:10:57.685356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:57.685822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:57.685932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:57.713841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:10:57.715124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:57.777881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1102/2186] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:10:57.824414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:10:57.826228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:10:57.915096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff542981-d24b-4e6d-b13e-e727b2a28146 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:10:57.920349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37ec13-3a37-49ca-9a82-6317604617b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:10:57.921050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ec13-3a37-49ca-9a82-6317604617b0 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:10:57.921330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ec13-3a37-49ca-9a82-6317604617b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:10:57.921597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37ec13-3a37-49ca-9a82-6317604617b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:10:57.930990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37ec13-3a37-49ca-9a82-6317604617b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:10:57.932545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37ec13-3a37-49ca-9a82-6317604617b0 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:10:57.941605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1085/2187] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 17:11:07.770938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:07.937263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:12.408349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:12.411129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:12.508764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0b1e1-11fd-4427-98b8-171c42491d25 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:12.516177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:12.517136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:12.517424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:12.517709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] PATH_INFO: `/v3/users/7fba89474aa14b91a842a518c3de7530` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:12.519032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fba89474aa14b91a842a518c3de7530)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:12.521508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:12.604897 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fba89474aa14b91a842a518c3de7530'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:12.616096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fba89474aa14b91a842a518c3de7530'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:12.616826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fba89474aa14b91a842a518c3de7530'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:12.634509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fba89474aa14b91a842a518c3de7530'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:12.645737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fba89474aa14b91a842a518c3de7530'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:12.656720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1103/2188] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:11:12 2022] DELETE /identity/v3/users/7fba89474aa14b91a842a518c3de7530 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:12.658797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:12.659316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:12.659415 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:12.682971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:12.684414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:12.773095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1086/2189] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:12.782372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:12.784172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:12.882885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95bfc-a606-4374-a4a4-e5284d892f8b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:12.887026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08b2e-3452-4617-99a2-c494231362a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:12.888134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08b2e-3452-4617-99a2-c494231362a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:12.888643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08b2e-3452-4617-99a2-c494231362a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:12.888864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08b2e-3452-4617-99a2-c494231362a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:12.899180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08b2e-3452-4617-99a2-c494231362a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:12.900780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08b2e-3452-4617-99a2-c494231362a9 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:12.913969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1104/2190] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:13.445502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:13.447679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:13.468292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dacfa7-0a4d-4982-963b-e0884951884a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:13.477220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:13.478809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:13.478809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:13.478809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] PATH_INFO: `/v3/projects/c77196a1a9a94eba8096e02075419ea5` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:13.480306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77196a1a9a94eba8096e02075419ea5)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:13.482866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:13.574960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77196a1a9a94eba8096e02075419ea5', 'request_id': 'req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:13.590900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77196a1a9a94eba8096e02075419ea5', 'request_id': 'req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:13.599549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77196a1a9a94eba8096e02075419ea5', 'request_id': 'req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:13.616493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] The token cache is being invalidate because project c77196a1a9a94eba8096e02075419ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:11:13.616820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:13.617496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-8c21ab5b-16e3-4ef3-bf76-4f24f2ca826e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:13.620752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1087/2191] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:11:13 2022] DELETE /identity/v3/projects/c77196a1a9a94eba8096e02075419ea5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:11:13.624275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:13.625343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:13.625825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:13.666206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:13.667719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:13.693351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:13.788458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1105/2192] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:13.790965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:13.793003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:13.793447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:13.827410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:13.830136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:13.844508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:13.847559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1088/2193] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:13.855647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b763a41-da32-441c-ac4f-ac93e2a723de None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:13.867334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:13.868181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:13.868473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:13.868992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:13.869762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:11:13.870078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:13.871760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:13.891424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:13.897046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1106/2194] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:11:13.902929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf622-0a59-4d3a-ac1a-80bbd0c5b7c8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:13.913727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:13.914682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:13.915167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:13.915638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:13.917355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:13.919708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:13.983369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1089/2195] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:11:13 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:11:13.988398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:14.013720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4f4d5-02eb-4e0d-a94a-a2c6ff8941cf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:14.164960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:14.164960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:14.164960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:14.167402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:14.168254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:14.180738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:14.227163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1107/2196] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:11:13 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:11:14.227920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:14.250972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd04e40-3636-4f10-8fb5-d6edd944ef44 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:14.278725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:14.280844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:14.281930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:14.286369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:14.288200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:14.300818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:14.343152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1090/2197] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:14.343928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:14.355852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328a8f-3db1-430d-8807-0b4019a98382 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:14.373330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b4c98-756a-4e8c-8ef7-c414df4a802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:14.374165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b4c98-756a-4e8c-8ef7-c414df4a802e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:14.374556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b4c98-756a-4e8c-8ef7-c414df4a802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:14.377254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b4c98-756a-4e8c-8ef7-c414df4a802e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:14.377254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b4c98-756a-4e8c-8ef7-c414df4a802e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:14.385697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b4c98-756a-4e8c-8ef7-c414df4a802e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:14.429388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1108/2198] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:14.431878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:14.459251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6dd89-f217-4486-a74f-b6ac59c6a07d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:14.477476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:14.478452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:14.478804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:14.479148 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] PATH_INFO: `/v3/projects/1d67075f4eaf4908acb0c2763153b81c/users/96f7eb5295ad40df898f93f1505a7df7/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:14.509629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d67075f4eaf4908acb0c2763153b81c, user_id=96f7eb5295ad40df898f93f1505a7df7, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:14.513209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:14.550178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1091/2199] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:11:14 2022] PUT /identity/v3/projects/1d67075f4eaf4908acb0c2763153b81c/users/96f7eb5295ad40df898f93f1505a7df7/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:14.551855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0508-724f-4f94-99bf-09c05eb6fa05 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:14.552217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0508-724f-4f94-99bf-09c05eb6fa05 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:14.552570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0508-724f-4f94-99bf-09c05eb6fa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:14.581117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2fdf0508-724f-4f94-99bf-09c05eb6fa05 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:14.583145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2fdf0508-724f-4f94-99bf-09c05eb6fa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:14.710923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1109/2200] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:14.722975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:14.725107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:14.776959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:14.830621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbd1c1-54aa-44aa-800c-19012d63caf6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:14.836374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:14.837417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:14.838157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:14.838501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:14.850271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:14.851908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:14.862973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1092/2201] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:21.921731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:21.922276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:21.922276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:21.954675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] MFA Rules not processed for user `96f7eb5295ad40df898f93f1505a7df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:21.956185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:21.965857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:22.038016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1110/2202] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:22.042622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:22.052499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8809c5-c0b1-45fd-9f53-3acbd581b8a8 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:22.057209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:22.057867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:22.058311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:22.058600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:22.059286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:22.061420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:22.090879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1093/2203] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:11:22 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:11:22.094865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:22.105943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090c9b-46c5-4dd6-84b3-a8acefe9f459 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:22.172622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:22.173975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:22.173975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:22.173975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:22.175536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:22.177513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:22.203836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1111/2204] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:11:22 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:11:22.207956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:22.219275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb6422-bbe0-4ba1-9456-dd088cb4f56b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:22.224198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:22.224905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:22.225185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:22.225636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:22.226396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:22.228011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:22.240281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1094/2205] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:22.244569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:22.256481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccefc07-c8c9-42b9-b06b-4edba11ab945 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:22.261819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:22.262713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:22.262999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:22.263305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] PATH_INFO: `/v3/projects/fa05dd41597a451bb010745761640a7f/users/3efe09b6a1984af194301d61962838b9/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:22.279417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa05dd41597a451bb010745761640a7f, user_id=3efe09b6a1984af194301d61962838b9, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:22.282878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:22.300849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1112/2206] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:11:22 2022] PUT /identity/v3/projects/fa05dd41597a451bb010745761640a7f/users/3efe09b6a1984af194301d61962838b9/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:22.302652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:22.313627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b837-d9ea-4910-840c-f833891b5fd2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:22.376085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284df258-621a-4739-af77-d214dcde26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:22.376621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df258-621a-4739-af77-d214dcde26f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:22.377051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df258-621a-4739-af77-d214dcde26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:22.377217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df258-621a-4739-af77-d214dcde26f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:22.377940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284df258-621a-4739-af77-d214dcde26f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:22.380121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284df258-621a-4739-af77-d214dcde26f9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:22.390750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1095/2207] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:22.394715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:22.407111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564cf2d-8158-430a-a98c-680c6c74a982 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:22.412266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:22.413301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:22.413586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:22.413870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] PATH_INFO: `/v3/projects/fa05dd41597a451bb010745761640a7f/users/3efe09b6a1984af194301d61962838b9/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:22.415968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa05dd41597a451bb010745761640a7f, user_id=3efe09b6a1984af194301d61962838b9, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:22.418838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:22.436135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1113/2208] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:11:22 2022] PUT /identity/v3/projects/fa05dd41597a451bb010745761640a7f/users/3efe09b6a1984af194301d61962838b9/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:23.016974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16013c63-d86d-491a-ba12-825c91e11c45 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:23.018136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16013c63-d86d-491a-ba12-825c91e11c45 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:23.018735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16013c63-d86d-491a-ba12-825c91e11c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:23.059340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-16013c63-d86d-491a-ba12-825c91e11c45 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:23.060629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-16013c63-d86d-491a-ba12-825c91e11c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:23.197351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1096/2209] 10.222.0.31 () {58 vars in 967 bytes} [Wed May 25 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:11:23.213579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:23.215787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:23.248428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c0a7-cce5-4a47-97f9-07aa8d3bd98b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:23.249082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c0a7-cce5-4a47-97f9-07aa8d3bd98b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:23.250103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c0a7-cce5-4a47-97f9-07aa8d3bd98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:23.287295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f343c0a7-cce5-4a47-97f9-07aa8d3bd98b None None] MFA Rules not processed for user `3f51c03f7fe54451b49ddb32fc337b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:23.288655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f343c0a7-cce5-4a47-97f9-07aa8d3bd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:23.300396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:23.356040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:23.362158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb50f5-d09a-4db5-a25a-3c020edf90cd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:23.367918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1097/2210] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:11:23.371173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:23.372206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:23.372778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:23.373307 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:23.391558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:23.394460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:23.404468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1114/2211] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:11:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:11:26.810522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:26.813624 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:26.814120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:26.863649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:26.876420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:26.905506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1098/2212] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:11:26.906738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:26.908492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:26.922477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:26.950284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684c994-8f91-42fb-8221-c362501093a7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:26.965362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:26.966210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:26.966669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:26.967102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:26.994955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:26.997590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:27.025232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1099/2213] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:11:27.159101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60fc0-6628-4aa6-b344-1e8d1c660b02 service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:27.193497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:27.194560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:27.194948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:27.195334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] PATH_INFO: `/v3/users/5afdfc7504694be8a8abc6fa07ed4e8f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:27.205034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afdfc7504694be8a8abc6fa07ed4e8f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:27.207345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:27.393437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afdfc7504694be8a8abc6fa07ed4e8f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:27.409143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afdfc7504694be8a8abc6fa07ed4e8f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:27.410240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afdfc7504694be8a8abc6fa07ed4e8f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:27.473171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afdfc7504694be8a8abc6fa07ed4e8f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:27.504366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-411979b0-af5a-42fe-abfa-575484dfa745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afdfc7504694be8a8abc6fa07ed4e8f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:27.529519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1115/2214] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:11:26 2022] DELETE /identity/v3/users/5afdfc7504694be8a8abc6fa07ed4e8f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:11:29.619953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:29.653428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251f40-1a3a-439e-bad7-dedae402a034 service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:29.784316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:29.785900 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:29.786438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:29.786997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] PATH_INFO: `/v3/projects/9452c1c2439d4247ad9a4e7e7f0ba486` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:29.790500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9452c1c2439d4247ad9a4e7e7f0ba486)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:29.795178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:29.892817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9452c1c2439d4247ad9a4e7e7f0ba486', 'request_id': 'req-42348069-61cb-4a71-971d-be4a8ef0dc7a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:29.912654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9452c1c2439d4247ad9a4e7e7f0ba486', 'request_id': 'req-42348069-61cb-4a71-971d-be4a8ef0dc7a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:29.926893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9452c1c2439d4247ad9a4e7e7f0ba486', 'request_id': 'req-42348069-61cb-4a71-971d-be4a8ef0dc7a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:29.965750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] The token cache is being invalidate because project 9452c1c2439d4247ad9a4e7e7f0ba486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:11:29.966112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:29.972218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-42348069-61cb-4a71-971d-be4a8ef0dc7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:29.979216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1100/2215] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:11:29 2022] DELETE /identity/v3/projects/9452c1c2439d4247ad9a4e7e7f0ba486 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:29.984315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:29.985539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:29.986045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.040599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:30.059978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:30.259924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1116/2216] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:30.267472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:30.267822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:30.268015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.301048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:30.302177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:30.325028 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1101/2217] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:30.331949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:30.348828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e119eb0-4060-4bdf-80ea-ca245d702699 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:30.381555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:30.382454 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:30.382883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:30.383316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.385272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:11:30.385666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:30.387498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:30.401585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:30.411257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1117/2218] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:11:30.415173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:30.434167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca8b6-c5ed-4ec2-a24c-8d15301e5866 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:30.466827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:30.467796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:30.468241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:30.468886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.469748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:30.472149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:30.536355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1102/2219] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:11:30 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:11:30.538254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:30.558634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653274a-6a27-4326-81f0-34cb9ed1f7dc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:30.745715 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:30.750032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:30.751452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:30.751797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.752647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:30.756816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:30.813519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1118/2220] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:11:30 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:11:30.814439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:30.821854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:30.841030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b891f02-41d3-4d0b-9995-a08fa409e6b0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:30.858765 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:30.864581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:30.866093 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:30.866607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.868413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:30.876617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:30.918362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1103/2221] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:30.923121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:30.935584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192b621-7ed3-4168-b26c-e491c3f35bbd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:30.958475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045c5ee-9408-4432-b6a3-e83a788c173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:30.959616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c5ee-9408-4432-b6a3-e83a788c173c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:30.960010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c5ee-9408-4432-b6a3-e83a788c173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:30.960412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c5ee-9408-4432-b6a3-e83a788c173c admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:30.961383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045c5ee-9408-4432-b6a3-e83a788c173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:30.963361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045c5ee-9408-4432-b6a3-e83a788c173c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:30.988376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1119/2222] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:30.989116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:31.002289 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56d0f-7617-40c4-a38a-396a52afd6fe admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:31.038443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:31.039608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:31.040459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:31.041243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] PATH_INFO: `/v3/projects/0f97d685bab047d8bbcd4c9e804f7d82/users/483fc20c75df406983982ee5a21b4913/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:31.084558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f97d685bab047d8bbcd4c9e804f7d82, user_id=483fc20c75df406983982ee5a21b4913, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:31.107840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:31.149070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1104/2223] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:11:30 2022] PUT /identity/v3/projects/0f97d685bab047d8bbcd4c9e804f7d82/users/483fc20c75df406983982ee5a21b4913/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:11:31.154840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7403c0-1816-481c-8d7d-1a3591196d41 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:31.155903 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7403c0-1816-481c-8d7d-1a3591196d41 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:31.156403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7403c0-1816-481c-8d7d-1a3591196d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:31.206453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-af7403c0-1816-481c-8d7d-1a3591196d41 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:31.206453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-af7403c0-1816-481c-8d7d-1a3591196d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:31.335006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1120/2224] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:31.360323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:31.363109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:31.522419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a3e-3a03-446a-9ad5-813ab3c736ef admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:31.527802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b43fa1-2af8-4079-8d8d-cd643db97e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:31.529024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b43fa1-2af8-4079-8d8d-cd643db97e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:31.529318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b43fa1-2af8-4079-8d8d-cd643db97e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:31.529731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b43fa1-2af8-4079-8d8d-cd643db97e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:31.558597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b43fa1-2af8-4079-8d8d-cd643db97e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:31.560709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b43fa1-2af8-4079-8d8d-cd643db97e1f service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:31.580484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1105/2225] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:32.691180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:32.691674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:32.691769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:32.738021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] MFA Rules not processed for user `3fb5eecf3e244058905ea3aba8112320`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:32.739351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:32.882303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c86b92-d7ba-42db-b7dd-d813c7f547ce None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:32.882820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c86b92-d7ba-42db-b7dd-d813c7f547ce None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:32.882902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c86b92-d7ba-42db-b7dd-d813c7f547ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:32.923933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1121/2226] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:32.948115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-77c86b92-d7ba-42db-b7dd-d813c7f547ce None None] MFA Rules not processed for user `483fc20c75df406983982ee5a21b4913`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:32.952461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-77c86b92-d7ba-42db-b7dd-d813c7f547ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:33.113470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1106/2227] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:33.124478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:33.126145 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:33.181724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:33.310813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf474aeb-e6a8-4b9d-8ad3-b2b56ec344b0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:33.319052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b290f-628c-4ca7-8a24-b882f0be4a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:33.319785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b290f-628c-4ca7-8a24-b882f0be4a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:33.320135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b290f-628c-4ca7-8a24-b882f0be4a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:33.320468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b290f-628c-4ca7-8a24-b882f0be4a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:33.333371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b290f-628c-4ca7-8a24-b882f0be4a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:33.335225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b290f-628c-4ca7-8a24-b882f0be4a12 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:33.359645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1122/2228] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:35.212509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:35.217907 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:35.218579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:35.258879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] MFA Rules not processed for user `483fc20c75df406983982ee5a21b4913`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:35.260452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:35.269804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1107/2229] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:35.400373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c95f0-e276-4e58-b049-59ec2ab82398 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:35.401335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c95f0-e276-4e58-b049-59ec2ab82398 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:35.401784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c95f0-e276-4e58-b049-59ec2ab82398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:35.467199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8a4c95f0-e276-4e58-b049-59ec2ab82398 None None] MFA Rules not processed for user `3efe09b6a1984af194301d61962838b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:35.470541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8a4c95f0-e276-4e58-b049-59ec2ab82398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:35.634837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1123/2230] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:36.095553 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:36.100025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:36.217535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:36.313433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48159-b6d0-4371-8b62-fec3926c5743 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:36.331450 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:36.331717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:36.332191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:36.332623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:36.336329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:36.443614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:36.445571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:36.468167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1108/2231] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:40.035843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef76fe-d405-4b4b-a74b-8d2eb4b619c9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:40.036431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef76fe-d405-4b4b-a74b-8d2eb4b619c9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:40.036671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef76fe-d405-4b4b-a74b-8d2eb4b619c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:40.071025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a6ef76fe-d405-4b4b-a74b-8d2eb4b619c9 None None] MFA Rules not processed for user `96f7eb5295ad40df898f93f1505a7df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:40.072432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a6ef76fe-d405-4b4b-a74b-8d2eb4b619c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:40.095639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1124/2232] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:40.159784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:40.162748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:40.203676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37ae92-d698-42c9-903d-0bf70534b240 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:40.224271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:40.225750 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:40.226042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:40.226321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] PATH_INFO: `/v3/users/68fa6de58a444ecc8c1772a543c5bee0` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:40.228403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fa6de58a444ecc8c1772a543c5bee0)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:40.235321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:40.386072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fa6de58a444ecc8c1772a543c5bee0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:40.388631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fa6de58a444ecc8c1772a543c5bee0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:40.392089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fa6de58a444ecc8c1772a543c5bee0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:40.418241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fa6de58a444ecc8c1772a543c5bee0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:40.436620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fa6de58a444ecc8c1772a543c5bee0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:40.467697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1109/2233] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:11:40 2022] DELETE /identity/v3/users/68fa6de58a444ecc8c1772a543c5bee0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:40.472363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:40.472734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:40.473026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:40.513682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:40.518594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:40.742440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1125/2234] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:40.754304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:40.756005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:40.892436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:40.929874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bd26-f736-4bf1-8085-618ec52079d4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:40.937868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa02ff-b86f-49d7-9b75-af9b11378f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:40.940139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa02ff-b86f-49d7-9b75-af9b11378f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:40.941949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa02ff-b86f-49d7-9b75-af9b11378f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:40.942257 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa02ff-b86f-49d7-9b75-af9b11378f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:40.963659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa02ff-b86f-49d7-9b75-af9b11378f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:40.971260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa02ff-b86f-49d7-9b75-af9b11378f87 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:41.011326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1110/2235] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:41.604922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:41.606370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:41.629667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f000-338e-459a-be17-c90c0e4059b7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:41.644272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:41.645406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:41.645873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:41.646162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] PATH_INFO: `/v3/projects/17b652b31745445a9901d2a3b8732bf3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:41.655582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b652b31745445a9901d2a3b8732bf3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:41.660161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:41.743021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:41.895460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b652b31745445a9901d2a3b8732bf3', 'request_id': 'req-f1d6f409-0ac3-4adc-853b-949ae1da593f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:41.922314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b652b31745445a9901d2a3b8732bf3', 'request_id': 'req-f1d6f409-0ac3-4adc-853b-949ae1da593f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:41.934981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b652b31745445a9901d2a3b8732bf3', 'request_id': 'req-f1d6f409-0ac3-4adc-853b-949ae1da593f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:41.971684 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] The token cache is being invalidate because project 17b652b31745445a9901d2a3b8732bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:11:41.972018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:41.973648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1d6f409-0ac3-4adc-853b-949ae1da593f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:41.975716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1126/2236] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:11:41 2022] DELETE /identity/v3/projects/17b652b31745445a9901d2a3b8732bf3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:41.980573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:41.981473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:41.982546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.019875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:42.021597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:42.106651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1111/2237] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:42.114583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.114889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.115175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.147342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:42.149207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:42.235548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1127/2238] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:42.239128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:42.256170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679d8c-9cb2-4e51-8bd1-18cc3fdc88b6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:42.289699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:42.292559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.292559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.292967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.296883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:11:42.297360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:42.314810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:42.369386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1112/2239] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:11:42.370761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:42.387602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38aa0-1bb2-4889-9ecb-a85b0badb4f5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:42.399950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:42.400557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.400873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.401154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.401865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:42.409403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:42.454260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1128/2240] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:11:42 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:11:42.458573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:42.473337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b18bdc-1056-41dd-a03e-295de9ab3f91 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:42.653759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:42.655267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.656434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.656854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.658445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:42.662013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:42.707236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1113/2241] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:11:42 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:11:42.709119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:42.725887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51d29-37e5-49b0-8a57-e132fa333a77 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:42.732652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:42.734380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.734875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.736446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.738009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:42.740607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:42.770237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1129/2242] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:42.772251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:42.822311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11735c48-076f-4cd8-b858-49b284b08490 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:42.832863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c1e8d-67ba-4b0f-b8c0-46b42f45adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:42.834152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c1e8d-67ba-4b0f-b8c0-46b42f45adb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.834679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c1e8d-67ba-4b0f-b8c0-46b42f45adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.835164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c1e8d-67ba-4b0f-b8c0-46b42f45adb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.836329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c1e8d-67ba-4b0f-b8c0-46b42f45adb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:42.838238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c1e8d-67ba-4b0f-b8c0-46b42f45adb3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:42.858692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:42.871094 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1114/2243] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:11:42.877057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847bcee-eb4b-433a-b3db-532396c60004 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:42.883343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:42.885096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.885799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.886468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] PATH_INFO: `/v3/projects/1129c2dfef484517a8971e381535d6ef/users/3703d17d57e24c0bb39630355848e4be/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:42.910159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1129c2dfef484517a8971e381535d6ef, user_id=3703d17d57e24c0bb39630355848e4be, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:42.914148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:42.934701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1130/2244] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:11:42 2022] PUT /identity/v3/projects/1129c2dfef484517a8971e381535d6ef/users/3703d17d57e24c0bb39630355848e4be/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:11:42.951977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:42.961658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:42.962101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:43.005480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] MFA Rules not processed for user `3703d17d57e24c0bb39630355848e4be`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:43.006785 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:43.095978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:43.161129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1115/2245] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:43.169551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:43.171829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:43.279434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2d6ef-231a-4df6-bdba-07e355fe5910 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:43.284571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360c389-4562-4a74-a4d1-7d711e06dd77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:43.285335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360c389-4562-4a74-a4d1-7d711e06dd77 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:43.285831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360c389-4562-4a74-a4d1-7d711e06dd77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:43.286192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360c389-4562-4a74-a4d1-7d711e06dd77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:43.296533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360c389-4562-4a74-a4d1-7d711e06dd77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:43.298034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360c389-4562-4a74-a4d1-7d711e06dd77 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:43.311051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1131/2246] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:51.945019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:52.010480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6921-e55e-4249-9b80-0417ad4d437b None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:52.015872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:52.016760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:52.017046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:52.017322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] PATH_INFO: `/v3/users/3703d17d57e24c0bb39630355848e4be` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:52.018538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3703d17d57e24c0bb39630355848e4be)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:52.020467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:52.073788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3703d17d57e24c0bb39630355848e4be'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:52.074436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3703d17d57e24c0bb39630355848e4be'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:52.075026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3703d17d57e24c0bb39630355848e4be'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:52.089056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3703d17d57e24c0bb39630355848e4be'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:52.097288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3703d17d57e24c0bb39630355848e4be'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:52.110298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1116/2247] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:11:51 2022] DELETE /identity/v3/users/3703d17d57e24c0bb39630355848e4be => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:11:52.114762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a817-298c-4454-9508-cf50ff429721 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:52.115346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a817-298c-4454-9508-cf50ff429721 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:52.115346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a817-298c-4454-9508-cf50ff429721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:52.132097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7612a817-298c-4454-9508-cf50ff429721 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:52.133353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7612a817-298c-4454-9508-cf50ff429721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:52.177726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:52.196812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1132/2248] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:11:52.207231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:52.208697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:52.272342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923277e-7897-483a-89b9-7ee08c8ffaee admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:52.276055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bc52d-518f-49c7-90e5-37c183e59942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:52.276726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc52d-518f-49c7-90e5-37c183e59942 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:52.277009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc52d-518f-49c7-90e5-37c183e59942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:52.277278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc52d-518f-49c7-90e5-37c183e59942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:52.287290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bc52d-518f-49c7-90e5-37c183e59942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:52.288858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bc52d-518f-49c7-90e5-37c183e59942 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:52.302853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1117/2249] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:53.103122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a817-298c-4454-9508-cf50ff429721 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:53.105570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7612a817-298c-4454-9508-cf50ff429721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:53.119028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a817-298c-4454-9508-cf50ff429721 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:53.123842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:53.124802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:53.125087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:53.125361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] PATH_INFO: `/v3/projects/1129c2dfef484517a8971e381535d6ef` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:53.126662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1129c2dfef484517a8971e381535d6ef)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:53.128543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:53.181565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1129c2dfef484517a8971e381535d6ef', 'request_id': 'req-bf6422a0-05ce-4200-bd50-f9b9aa93757a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:53.193981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1129c2dfef484517a8971e381535d6ef', 'request_id': 'req-bf6422a0-05ce-4200-bd50-f9b9aa93757a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:53.201392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1129c2dfef484517a8971e381535d6ef', 'request_id': 'req-bf6422a0-05ce-4200-bd50-f9b9aa93757a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:53.218917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] The token cache is being invalidate because project 1129c2dfef484517a8971e381535d6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:11:53.219566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:53.220667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bf6422a0-05ce-4200-bd50-f9b9aa93757a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:11:53.222620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1133/2250] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:11:53 2022] DELETE /identity/v3/projects/1129c2dfef484517a8971e381535d6ef => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:11:53.844913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448947-e2ff-45f9-b7e7-a56123d1ece4 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:53.845446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448947-e2ff-45f9-b7e7-a56123d1ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:53.845605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448947-e2ff-45f9-b7e7-a56123d1ece4 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:53.847077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1118/2251] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:11:53.853700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63459-d363-4f55-b5e5-8c24637cb8e2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:53.853989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63459-d363-4f55-b5e5-8c24637cb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:53.854433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63459-d363-4f55-b5e5-8c24637cb8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:53.937234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c9b63459-d363-4f55-b5e5-8c24637cb8e2 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:53.938767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c9b63459-d363-4f55-b5e5-8c24637cb8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:54.062463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1134/2252] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:54.074578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13448947-e2ff-45f9-b7e7-a56123d1ece4 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:54.076510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-13448947-e2ff-45f9-b7e7-a56123d1ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:54.081139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:54.172923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13448947-e2ff-45f9-b7e7-a56123d1ece4 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:54.176903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b524-338a-4139-9fbe-cc4b13b85e7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:54.177559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b524-338a-4139-9fbe-cc4b13b85e7e service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.177847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b524-338a-4139-9fbe-cc4b13b85e7e service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.178123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b524-338a-4139-9fbe-cc4b13b85e7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.189371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9b524-338a-4139-9fbe-cc4b13b85e7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:54.190860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9b524-338a-4139-9fbe-cc4b13b85e7e service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:54.202064 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1119/2253] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:54.269552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34710aec-6f04-42e3-aeef-0dab11fc34db None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.270111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34710aec-6f04-42e3-aeef-0dab11fc34db None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.270207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34710aec-6f04-42e3-aeef-0dab11fc34db None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.271504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1135/2254] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:11:54.276358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea8c2-ea0a-4a27-8356-f29f7d107717 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.276648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea8c2-ea0a-4a27-8356-f29f7d107717 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.276957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea8c2-ea0a-4a27-8356-f29f7d107717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.295578 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-abbea8c2-ea0a-4a27-8356-f29f7d107717 None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:54.296891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-abbea8c2-ea0a-4a27-8356-f29f7d107717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:54.347009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1120/2255] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:54.359290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34710aec-6f04-42e3-aeef-0dab11fc34db None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:54.360949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-34710aec-6f04-42e3-aeef-0dab11fc34db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:54.373886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34710aec-6f04-42e3-aeef-0dab11fc34db None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:54.377397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a696888-b836-454b-a47f-0326143b884a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:54.378029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696888-b836-454b-a47f-0326143b884a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.378318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696888-b836-454b-a47f-0326143b884a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.378599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696888-b836-454b-a47f-0326143b884a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.385607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a696888-b836-454b-a47f-0326143b884a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:54.387092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a696888-b836-454b-a47f-0326143b884a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:54.394846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1136/2256] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:54.480539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3a31-f755-4ed3-a662-37b85f7a2b7a None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.481012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3a31-f755-4ed3-a662-37b85f7a2b7a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.481300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3a31-f755-4ed3-a662-37b85f7a2b7a None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.482910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1121/2257] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:11:54.488342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98802449-54da-4c25-82b0-f6c88088f3b2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.488656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98802449-54da-4c25-82b0-f6c88088f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.488946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98802449-54da-4c25-82b0-f6c88088f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.507327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-98802449-54da-4c25-82b0-f6c88088f3b2 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:54.508531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-98802449-54da-4c25-82b0-f6c88088f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:54.520064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1137/2258] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:54.530999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3a31-f755-4ed3-a662-37b85f7a2b7a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:54.541956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3a31-f755-4ed3-a662-37b85f7a2b7a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:54.545643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:54.546329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:54.546608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:54.546927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:54.557066 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:54.558512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:54.569791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1122/2259] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:11:59.597937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:59.598787 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:59.599257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:59.658547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:59.669189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:11:59.671404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:59.747432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1138/2260] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:11:59.770520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:11:59.771978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:11:59.876392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:11:59.879475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75f0a-42c1-4197-a3f6-812adbdbbc8c service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:11:59.887142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bd1a7-0dc9-48cd-912f-18cadd599926 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:11:59.888082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd1a7-0dc9-48cd-912f-18cadd599926 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:11:59.888366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd1a7-0dc9-48cd-912f-18cadd599926 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:11:59.889300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd1a7-0dc9-48cd-912f-18cadd599926 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:11:59.898421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bd1a7-0dc9-48cd-912f-18cadd599926 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:11:59.900161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bd1a7-0dc9-48cd-912f-18cadd599926 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:11:59.921046 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1123/2261] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 17:12:09.741199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=27 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:09.909448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:13.312434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:12:13.314325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:12:13.409743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36611e4b-0637-4562-a1ea-768851263ae4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:12:13.414638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:12:13.415283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:12:13.415570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:12:13.415847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:12:13.417640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:12:13.429321 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:12:13.430924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:12:13.441280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1139/2262] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:12:23.436865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=41 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:26.170534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:12:26.172371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:12:26.172752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:12:26.194726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:12:26.196052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:12:26.205544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1124/2263] 10.222.0.31 () {58 vars in 967 bytes} [Wed May 25 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:12:26.220036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:12:26.239472 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0150f-6e70-46e7-bcff-b9666fb5e6a7 service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:12:26.244964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e557-3468-4ce1-9076-11a1aad48f6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:12:26.245868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e557-3468-4ce1-9076-11a1aad48f6e service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:12:26.246245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e557-3468-4ce1-9076-11a1aad48f6e service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:12:26.246614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e557-3468-4ce1-9076-11a1aad48f6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:12:26.255632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e557-3468-4ce1-9076-11a1aad48f6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:12:26.257337 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e557-3468-4ce1-9076-11a1aad48f6e service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:12:26.266165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1140/2264] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:12:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:12:32.946161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:12:32.947580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:12:32.959306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c7b3-1c33-4558-a1f9-428399a79ede None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:12:32.962894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:12:32.963531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:12:32.963812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:12:32.964084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:12:32.966299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:12:33.030807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:12:33.032261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd96d82-a096-4baf-96ba-42b8446c8482 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:12:33.041736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1125/2265] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:12:36.262453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:43.037568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=33 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:12:57.226725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8ecc2-101c-4fc3-9ba4-723aea39e85f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:12:57.227207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8ecc2-101c-4fc3-9ba4-723aea39e85f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:12:57.227308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8ecc2-101c-4fc3-9ba4-723aea39e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:12:57.246341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c4c8ecc2-101c-4fc3-9ba4-723aea39e85f None None] MFA Rules not processed for user `483fc20c75df406983982ee5a21b4913`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:12:57.247539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c4c8ecc2-101c-4fc3-9ba4-723aea39e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:12:57.300457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1141/2266] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:12:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:13:07.293965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=25 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:19.337212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411188e-9cf2-48ce-9533-ca41fc131280 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:13:19.337747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411188e-9cf2-48ce-9533-ca41fc131280 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:13:19.337851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411188e-9cf2-48ce-9533-ca41fc131280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:13:19.355630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4411188e-9cf2-48ce-9533-ca41fc131280 None None] MFA Rules not processed for user `3fb5eecf3e244058905ea3aba8112320`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:13:19.356962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4411188e-9cf2-48ce-9533-ca41fc131280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:13:19.420881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1126/2267] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:13:20.508495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:13:20.509005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:13:20.509189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:13:20.528391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] MFA Rules not processed for user `3f51c03f7fe54451b49ddb32fc337b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:13:20.529629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:13:20.585518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1142/2268] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:13:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:13:29.413312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=25 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:30.579562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=25 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:13:37.288156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:13:37.288692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:13:37.288819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:13:37.307409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] MFA Rules not processed for user `41618b0540e64de4b968d5cdc39bea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:13:37.308638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:13:37.367675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1127/2269] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:13:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:13:47.360871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=25 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:02.411073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:02.412575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:02.477926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eb6cf-a5dc-4eb5-abb0-25e52f68d91e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:02.483639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:02.484512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:02.484831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:02.485106 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] PATH_INFO: `/v3/users/483fc20c75df406983982ee5a21b4913` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:02.486292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] RBAC: Authorizing `identity:delete_user(user_id=483fc20c75df406983982ee5a21b4913)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:02.488259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:02.537207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483fc20c75df406983982ee5a21b4913'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.546066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483fc20c75df406983982ee5a21b4913'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.546671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483fc20c75df406983982ee5a21b4913'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.558450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483fc20c75df406983982ee5a21b4913'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.565716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89d70901-7128-4a03-a701-1364cb30516f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483fc20c75df406983982ee5a21b4913'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.571867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1143/2270] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:02 2022] DELETE /identity/v3/users/483fc20c75df406983982ee5a21b4913 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:02.749656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:02.762188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd4f4-e925-4e45-8f65-666acce6a32d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:02.827178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:02.828044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:02.828323 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:02.828595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] PATH_INFO: `/v3/projects/0f97d685bab047d8bbcd4c9e804f7d82` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:02.829916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f97d685bab047d8bbcd4c9e804f7d82)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:02.831854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:02.875746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f97d685bab047d8bbcd4c9e804f7d82', 'request_id': 'req-09dcca78-3631-4e17-b957-c6c23f73add0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.882054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f97d685bab047d8bbcd4c9e804f7d82', 'request_id': 'req-09dcca78-3631-4e17-b957-c6c23f73add0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.888668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f97d685bab047d8bbcd4c9e804f7d82', 'request_id': 'req-09dcca78-3631-4e17-b957-c6c23f73add0'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.899617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] The token cache is being invalidate because project 0f97d685bab047d8bbcd4c9e804f7d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:14:02.899972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.901223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-09dcca78-3631-4e17-b957-c6c23f73add0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:02.902831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1128/2271] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:14:02 2022] DELETE /identity/v3/projects/0f97d685bab047d8bbcd4c9e804f7d82 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:02.909240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:02.909538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:02.909819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:02.927746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:02.928987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:02.988636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1144/2272] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:02.997049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:02.997360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:02.997662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.016169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:03.017419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:03.025922 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1129/2273] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:03.030097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.039567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7af0-4baa-454c-9073-3ad38c5045f3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.044511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.045192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.045474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.045745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.046497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:14:03.046806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.048397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.060816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1145/2274] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:14:03.065534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.075557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d566-8553-41a7-a1b2-084b03ad4b43 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.080318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.080936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.081223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.081503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.082202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.084119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.109239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1130/2275] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:03 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:03.113316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.124190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6da9-89e7-4f08-8369-6b7f80538835 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.127777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:03.183990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.184709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.184998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.185276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.185956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.188171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.208369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1146/2276] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:03 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:03.212445 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.222764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa099c-d75c-414f-a4a5-bbbdce20d14c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.227431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.228132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.228418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.228723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.229609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.231253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.241589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1131/2277] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:03.246002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.256265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086c66-fdf7-4c93-bab0-b398831a7d67 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.261548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec478-2e98-4361-8fa7-dedc2c222e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.262201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec478-2e98-4361-8fa7-dedc2c222e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.262488 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec478-2e98-4361-8fa7-dedc2c222e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.262764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec478-2e98-4361-8fa7-dedc2c222e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.263485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec478-2e98-4361-8fa7-dedc2c222e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.265113 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec478-2e98-4361-8fa7-dedc2c222e02 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.275295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1147/2278] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:03.279539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.289401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecc4e-4245-4817-9d40-e9156960d026 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.294181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.295056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.295340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.295630 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] PATH_INFO: `/v3/projects/df9bc8d103cf40e1b8d984f1947e7c5d/users/47642301725e4023aba48b2a3a64d5b9/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.312312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9bc8d103cf40e1b8d984f1947e7c5d, user_id=47642301725e4023aba48b2a3a64d5b9, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.315951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.333135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1132/2279] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:03 2022] PUT /identity/v3/projects/df9bc8d103cf40e1b8d984f1947e7c5d/users/47642301725e4023aba48b2a3a64d5b9/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:03.338116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb6f7f-4e56-4d48-9fdd-0407298798d2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.338404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb6f7f-4e56-4d48-9fdd-0407298798d2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.338682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb6f7f-4e56-4d48-9fdd-0407298798d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.356363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0adb6f7f-4e56-4d48-9fdd-0407298798d2 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:03.357596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0adb6f7f-4e56-4d48-9fdd-0407298798d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:03.416287 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1148/2280] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:03.425872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:03.427546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:03.458200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:03.487303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec31a9-4b78-4419-998c-740f36a80a9b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:03.490967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:03.491606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:03.491889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:03.492166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:03.502187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:03.503661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:03.513141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1133/2281] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:07.346360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.346807 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.346925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.376710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] MFA Rules not processed for user `47642301725e4023aba48b2a3a64d5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:07.378030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:07.456448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1149/2282] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:07.460848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:07.471611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2c60c-a6f7-429a-af67-6db91e69706f service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:07.476308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:07.477205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.477678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.479328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.480217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:07.482198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:07.511468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1134/2283] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:07 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:07.515683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:07.541023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b643e0a-1d9d-4689-8488-94cd2c9d06be None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:07.553504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:07.603188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:07.604018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.604234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.604536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.605250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:07.607184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:07.629761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1150/2284] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:07 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:07.639590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:07.650637 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813220-4b72-4203-bc6e-22a632afcab1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:07.655767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:07.656448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.656763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.657070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.657806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:07.659454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:07.671653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1135/2285] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:14:07.675924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:07.687586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8544-6388-4b29-bd8e-31349baf2e0c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:07.692446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:07.693378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.693714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.693999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] PATH_INFO: `/v3/projects/63624ae00fdd4c0a9b94c7fc2887fdb9/users/c9ccc8ef411b4f6782536bced8440fb5/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.710531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63624ae00fdd4c0a9b94c7fc2887fdb9, user_id=c9ccc8ef411b4f6782536bced8440fb5, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:07.713474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:07.747414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1151/2286] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:07 2022] PUT /identity/v3/projects/63624ae00fdd4c0a9b94c7fc2887fdb9/users/c9ccc8ef411b4f6782536bced8440fb5/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:07.753850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:07.765524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379c4a-2cf9-47dd-a875-279cdf539476 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:07.829723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:07.830406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.830689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.830972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.831708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:07.833406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:07.844826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1136/2287] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:07.848343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:07.865815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689a6a-1e24-49ac-b0b5-2ad9c077daf4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:07.871381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3429fe-3348-46c5-825f-67d94bb01ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:07.872286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3429fe-3348-46c5-825f-67d94bb01ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:07.872571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3429fe-3348-46c5-825f-67d94bb01ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:07.872890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3429fe-3348-46c5-825f-67d94bb01ad1 admin admin] PATH_INFO: `/v3/projects/63624ae00fdd4c0a9b94c7fc2887fdb9/users/c9ccc8ef411b4f6782536bced8440fb5/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:07.874893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3429fe-3348-46c5-825f-67d94bb01ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63624ae00fdd4c0a9b94c7fc2887fdb9, user_id=c9ccc8ef411b4f6782536bced8440fb5, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:07.877956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3429fe-3348-46c5-825f-67d94bb01ad1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:07.889971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1152/2288] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:07 2022] PUT /identity/v3/projects/63624ae00fdd4c0a9b94c7fc2887fdb9/users/c9ccc8ef411b4f6782536bced8440fb5/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:08.654903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:08.735809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462740f-f4c2-42c7-b1d3-7dd6881781c3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:08.848479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:08.859144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:08.860130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:08.860700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:08.861187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:08.864512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:09.048160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:09.049746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:09.073117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1137/2289] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:14:14.724764 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556773a-ab11-4a92-b225-360d290d54da None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:14.726398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556773a-ab11-4a92-b225-360d290d54da None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:14.726891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556773a-ab11-4a92-b225-360d290d54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:14.764228 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b556773a-ab11-4a92-b225-360d290d54da None None] MFA Rules not processed for user `c9ccc8ef411b4f6782536bced8440fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:14.765902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b556773a-ab11-4a92-b225-360d290d54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:14.865863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1153/2290] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:14.880444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:14.881986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:14.914349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b2f7-d04f-4ff6-99d2-bb5ed2de5255 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:14.922895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:14.923583 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:14.923870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:14.924144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:14.998903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:15.000561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:15.020210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1138/2291] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:15.150580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:15.150881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:15.151142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:15.220891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] MFA Rules not processed for user `902f574061e64236ae8d6df08093c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:15.222131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:15.310226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:15.330869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1154/2292] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:15.373137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:15.374576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:15.479044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e76c-14f3-42d0-8e9b-484b36187fb4 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:15.483304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:15.483972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:15.484261 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:15.484567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:15.486447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:15.504855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:15.506352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:15.520591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1139/2293] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:15.897798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:15.899438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:15.913645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96123e-5d08-48b4-bf2d-d20f52ddd57b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:15.918770 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:15.919692 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:15.920143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:15.920430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:15.922538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:15.934376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:15.936111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:15.949534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1155/2294] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:16.327287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:16.328804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:16.391924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:16.447985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a80782-db54-4c6b-ad73-cbcdfcc6f421 service glance] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:16.453515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:16.454263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:16.454614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:16.454948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:16.457068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:16.473079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:16.474778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:16.486138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1140/2295] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:17.428878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:17.453582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb208ed-c2be-46f1-a6f7-7d75e5806915 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:17.463076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:17.463994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:17.464476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:17.464965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:17.468224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:17.486029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:17.487766 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:17.498521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1156/2296] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:26.480884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=18 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:27.493299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=13 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:28.498045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:28.499674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:28.516187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27cc7b-93cd-417c-b792-e4dc12b47732 service placement] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:28.521768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:28.522455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:28.522746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:28.523023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:28.525477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:28.588083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:28.591346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de23b68-fbad-4dca-ac6a-970b457916b7 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:28.601085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1141/2297] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:29.018990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:29.029463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124908e-3bc8-40c7-9d67-434bbc782a7a service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:29.034610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:29.035930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:29.036371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:29.036564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:29.038822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:29.050234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:29.051682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:29.060342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1157/2298] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:32.843728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325031e-741d-418c-999a-55762b1b7921 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:32.844304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325031e-741d-418c-999a-55762b1b7921 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:32.844304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325031e-741d-418c-999a-55762b1b7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:32.861942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c325031e-741d-418c-999a-55762b1b7921 None None] MFA Rules not processed for user `47642301725e4023aba48b2a3a64d5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:32.863133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c325031e-741d-418c-999a-55762b1b7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:32.870974 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1142/2299] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:14:33.228631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:33.237400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1c4ee-c957-415d-ab94-04b711972a1f service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:33.241159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:33.241802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:33.242088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:33.242893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:33.244976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:33.254780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:33.256218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:33.265953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1158/2300] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:33.538040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325031e-741d-418c-999a-55762b1b7921 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:33.540275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c325031e-741d-418c-999a-55762b1b7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:33.607089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325031e-741d-418c-999a-55762b1b7921 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:33.611003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:33.611734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:33.612092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:33.612441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:33.614509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:33.684500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:33.686131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:33.699027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1143/2301] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:36.496628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:36.530556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b8992-567c-49a0-9d5f-23b0c117e1b6 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:36.551327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:36.560449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:36.560930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:36.561830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:36.564351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:36.606406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:36.608281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:36.637079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1159/2302] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:37.564324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:37.577244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49c9a-98b0-4421-8502-c8f485d67524 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:37.587297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:37.589311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:37.589609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:37.589894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:37.592284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:37.680433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:37.709009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:37.710476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:37.721470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1144/2303] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:14:39.263844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:39.276285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651333-774d-425b-a9dd-de8921951790 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:39.282919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:39.283597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:39.283881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:39.284154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:39.286035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:39.355020 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:39.356649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:39.367628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1160/2304] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:42.657126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:42.659156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:42.681598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ef6b-3785-4f2a-b840-467f60a475a4 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:42.686861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:42.687854 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:42.688267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:42.688633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] PATH_INFO: `/v3/users/3f51c03f7fe54451b49ddb32fc337b98` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:42.689946 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f51c03f7fe54451b49ddb32fc337b98)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:42.691996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:42.747384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f51c03f7fe54451b49ddb32fc337b98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:42.748101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f51c03f7fe54451b49ddb32fc337b98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:42.748766 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f51c03f7fe54451b49ddb32fc337b98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:42.762788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f51c03f7fe54451b49ddb32fc337b98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:42.770505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-1b2986bd-1235-4aa3-ba5b-cb7b72b23ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f51c03f7fe54451b49ddb32fc337b98'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:42.798748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1145/2305] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:42 2022] DELETE /identity/v3/users/3f51c03f7fe54451b49ddb32fc337b98 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:43.117477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.129927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101856-c095-4ab0-a04b-4c9488ec5df4 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.259988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.260921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.261558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.262006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] PATH_INFO: `/v3/projects/8c297ec7b46943f594b67c95479f1f7c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.263430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c297ec7b46943f594b67c95479f1f7c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.265581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.343411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c297ec7b46943f594b67c95479f1f7c', 'request_id': 'req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:43.350938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c297ec7b46943f594b67c95479f1f7c', 'request_id': 'req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:43.354804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:43.359945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c297ec7b46943f594b67c95479f1f7c', 'request_id': 'req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:43.382071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] The token cache is being invalidate because project 8c297ec7b46943f594b67c95479f1f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:14:43.382728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:43.384645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-40ad5e66-e9ed-4bb2-9242-4f54020bc1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:43.386583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1161/2306] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:14:43 2022] DELETE /identity/v3/projects/8c297ec7b46943f594b67c95479f1f7c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:43.391614 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.392135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.392480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.410979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:43.412522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:43.491771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1146/2307] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:14:43.500101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.500399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.500765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.519580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:43.520818 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:43.532966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1162/2308] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:43.533941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.544812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac755bc-ba6a-41a0-8284-be957f795669 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.549522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.550180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.550457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.550732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.551476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:14:43.551780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.553443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.566549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1147/2309] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:14:43.571275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.580612 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dec0b-59db-4252-ba9c-32cc3e6a9880 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.586144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.586908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.587203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.587486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.588161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.590111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.619992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1163/2310] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:43 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:14:43.621190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.631809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d138e3d-89d1-4ba0-b085-a2c847314067 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.671813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:43.691791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.692468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.692817 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.693077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.693779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.695902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.722821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1148/2311] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:43 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:43.724458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.736288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f00bec-3db4-4d91-960b-59c4a0ff2f87 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.741363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.742703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.742998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.743416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.744152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.745771 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.757122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1164/2312] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:14:43.761180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.771213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693979b-175a-46fb-99a7-b51b2c4a8bfb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.776512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71115b46-84d6-40b9-83c8-797c8c8df1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.777210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115b46-84d6-40b9-83c8-797c8c8df1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.777492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115b46-84d6-40b9-83c8-797c8c8df1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.777878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115b46-84d6-40b9-83c8-797c8c8df1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.778603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71115b46-84d6-40b9-83c8-797c8c8df1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.780191 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71115b46-84d6-40b9-83c8-797c8c8df1ce admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.790831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1149/2313] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:43.795477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:43.810174 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc207be-4791-47ef-b8ca-b1fe7d22e770 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:43.815670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:43.816566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.816884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.817160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] PATH_INFO: `/v3/projects/dcc3e211730e4bb1b3dd4ca151cde4e8/users/bdaa52cab2334a18b92ad5fb634ed383/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.834622 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3e211730e4bb1b3dd4ca151cde4e8, user_id=bdaa52cab2334a18b92ad5fb634ed383, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:43.837369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:43.851777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1165/2314] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:43 2022] PUT /identity/v3/projects/dcc3e211730e4bb1b3dd4ca151cde4e8/users/bdaa52cab2334a18b92ad5fb634ed383/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:43.871997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcff9-a5ca-40d0-bcb7-d1bbe9e2708d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:43.872287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcff9-a5ca-40d0-bcb7-d1bbe9e2708d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:43.872565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcff9-a5ca-40d0-bcb7-d1bbe9e2708d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:43.904749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-93bfcff9-a5ca-40d0-bcb7-d1bbe9e2708d None None] MFA Rules not processed for user `bdaa52cab2334a18b92ad5fb634ed383`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:43.906113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-93bfcff9-a5ca-40d0-bcb7-d1bbe9e2708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:43.996471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1150/2315] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:44.008295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:44.010015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:44.072883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233f8c-1b2a-49e2-acfb-0976bbb56cd9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:44.077123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:44.077882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:44.078244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:44.078552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:44.087747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:44.089252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:44.098609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1166/2316] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:45.210386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:45.210386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:45.210386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:45.237991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] MFA Rules not processed for user `3fb5eecf3e244058905ea3aba8112320`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:45.239226 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:45.328615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1151/2317] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:50.929524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:50.931042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:51.007055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e229bc-7c99-4676-9230-841e2ab8a568 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:51.013210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:51.013854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:51.014135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:51.014405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:51.016147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:51.028410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:51.030015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a39f-ce96-468e-9c35-b5918151a2f9 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:51.040195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1167/2318] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:52.821220 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:52.887414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:52.904771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550221a7-780b-4774-852b-c6136e6ade06 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:52.910602 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9319-0364-4454-873f-386f20601076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:52.911561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9319-0364-4454-873f-386f20601076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:52.911917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9319-0364-4454-873f-386f20601076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:52.912263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9319-0364-4454-873f-386f20601076 admin admin] PATH_INFO: `/v3/users/bdaa52cab2334a18b92ad5fb634ed383` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:52.914145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c9319-0364-4454-873f-386f20601076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdaa52cab2334a18b92ad5fb634ed383)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:52.916243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c9319-0364-4454-873f-386f20601076 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:52.965956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdaa52cab2334a18b92ad5fb634ed383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:52.966871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdaa52cab2334a18b92ad5fb634ed383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:52.967744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdaa52cab2334a18b92ad5fb634ed383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:52.981683 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdaa52cab2334a18b92ad5fb634ed383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:52.989304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdaa52cab2334a18b92ad5fb634ed383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:53.002992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1152/2319] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:52 2022] DELETE /identity/v3/users/bdaa52cab2334a18b92ad5fb634ed383 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:53.008221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:53.008744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:53.008843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:53.026428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:53.027712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:53.038993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:53.096239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1168/2320] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:53.106745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:53.108262 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:53.170321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9319-0364-4454-873f-386f20601076 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:53.174058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9e051-dd08-4607-a46f-1124ac781048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:53.174751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9e051-dd08-4607-a46f-1124ac781048 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:53.174996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9e051-dd08-4607-a46f-1124ac781048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:53.175265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9e051-dd08-4607-a46f-1124ac781048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:53.185843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9e051-dd08-4607-a46f-1124ac781048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:53.187547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9e051-dd08-4607-a46f-1124ac781048 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:53.197408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1153/2321] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:53.703259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:53.705053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:53.734560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea88da-092e-4ded-acd9-9ca3c6b9b1d7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:53.742557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:53.743535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:53.743902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:53.744242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] PATH_INFO: `/v3/projects/dcc3e211730e4bb1b3dd4ca151cde4e8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:53.745556 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc3e211730e4bb1b3dd4ca151cde4e8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:53.747533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:53.803409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc3e211730e4bb1b3dd4ca151cde4e8', 'request_id': 'req-e6a32eb5-fbcf-4938-bec1-a0758517cda1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:53.810874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc3e211730e4bb1b3dd4ca151cde4e8', 'request_id': 'req-e6a32eb5-fbcf-4938-bec1-a0758517cda1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:53.819027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc3e211730e4bb1b3dd4ca151cde4e8', 'request_id': 'req-e6a32eb5-fbcf-4938-bec1-a0758517cda1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:53.838155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] The token cache is being invalidate because project dcc3e211730e4bb1b3dd4ca151cde4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:14:53.838460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:53.839152 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e6a32eb5-fbcf-4938-bec1-a0758517cda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:53.841576 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1169/2322] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:14:53 2022] DELETE /identity/v3/projects/dcc3e211730e4bb1b3dd4ca151cde4e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:53.846432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:53.846960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:53.846960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:53.865385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:53.866759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:53.929029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1154/2323] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:53.938936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:53.939236 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:53.939565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:53.962456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:53.963790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:53.974219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1170/2324] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:53.977250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:53.987245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4210b2-17c6-458a-bc68-655a61bab623 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:53.992157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:53.992969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:53.993330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:53.993677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:53.994487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:14:53.994870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:53.996555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.012722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1155/2325] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:14:54.015084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.025457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c53ec-207a-4826-8fad-ec136f107e01 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.030446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.031137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.032017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.032017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.032526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.034722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.068338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1171/2326] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:54 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:54.073119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.081990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:54.093877 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf949f-bf6d-4696-a150-2d2fd1ad2aef admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.108591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.110362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:54.162550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.163230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.163706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.164560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.165288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.167238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.173077 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08e33-063c-40e9-914f-88c6c0cc8f22 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.176848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.177523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.177853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.178096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.180702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:54.188152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1156/2327] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:54 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:54.192140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.203609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c645c12-07f0-4e84-b352-1b681796306d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.204045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:54.209980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.211356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.211682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.211991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.212821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.214429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.224823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1157/2328] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:14:54.228927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.239755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f7d1d-a330-4e4c-abb1-0a2093a52fc2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.245804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.246574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.246932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.247835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.248642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.250402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.254742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.256253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13dace-40c0-4d26-81ce-cc37560d2e5a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.267809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1158/2329] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:14:54.268856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.269747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1172/2330] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:14:54.280162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd461ac-9815-4337-939a-b2d0e21bb7b3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.284948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.285890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.286200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.286507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] PATH_INFO: `/v3/projects/6e66ad647a7e41fe80bc8088161c3746/users/89440dfaf3c44af99300b4ff3e4feefd/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.302006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e66ad647a7e41fe80bc8088161c3746, user_id=89440dfaf3c44af99300b4ff3e4feefd, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.305489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.321138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1159/2331] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:54 2022] PUT /identity/v3/projects/6e66ad647a7e41fe80bc8088161c3746/users/89440dfaf3c44af99300b4ff3e4feefd/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:14:54.331313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.331610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.331898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.372531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] MFA Rules not processed for user `89440dfaf3c44af99300b4ff3e4feefd`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:54.375215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:54.455996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1173/2332] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:54.460708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.524279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8433-c241-453a-bba7-2976d63805ab admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.529708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.530400 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.530649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.530930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.531701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.533667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.559810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1160/2333] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:54 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:54.564306 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.575931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66087253-5248-432e-8af2-4329d1ed5d49 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.636878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.638100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.638387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.638664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.639346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.641301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.664841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1174/2334] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:54 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:14:54.666269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.690137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0eecb-257e-4290-9494-4d7e1abb8fb7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.695987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.697110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.697286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.697629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.698464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.700147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.712178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1161/2335] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:14:54.716338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.727705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfee2b-9b81-4956-983f-33f926b36c91 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.732743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.733651 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.733936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.734224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] PATH_INFO: `/v3/projects/791e65da83a34c12a6153f3ac478ce0c/users/3988e4104ab644809a213bef20994b8a/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.751117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=791e65da83a34c12a6153f3ac478ce0c, user_id=3988e4104ab644809a213bef20994b8a, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.753840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.768204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1175/2336] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:54 2022] PUT /identity/v3/projects/791e65da83a34c12a6153f3ac478ce0c/users/3988e4104ab644809a213bef20994b8a/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:54.772292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.785716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f749201-f709-462e-bfc7-7de04871f8df admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.803403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:54.853154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a48003-281a-46bf-a063-eb940f3ad2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.853981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a48003-281a-46bf-a063-eb940f3ad2ed admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.854272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a48003-281a-46bf-a063-eb940f3ad2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.854604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a48003-281a-46bf-a063-eb940f3ad2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.855349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a48003-281a-46bf-a063-eb940f3ad2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.857990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a48003-281a-46bf-a063-eb940f3ad2ed admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.869240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1162/2337] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:54.873376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:54.885288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c967-de4d-47dc-a3ee-47e658ea2aae admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:54.891002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:54.892010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.892292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.892671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] PATH_INFO: `/v3/projects/791e65da83a34c12a6153f3ac478ce0c/users/3988e4104ab644809a213bef20994b8a/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.895310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791e65da83a34c12a6153f3ac478ce0c, user_id=3988e4104ab644809a213bef20994b8a, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:54.901441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:54.909557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:54.919415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1176/2338] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:54 2022] PUT /identity/v3/projects/791e65da83a34c12a6153f3ac478ce0c/users/3988e4104ab644809a213bef20994b8a/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:54.929825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330871c-691b-4710-890b-a64a50963a08 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:54.930116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330871c-691b-4710-890b-a64a50963a08 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:54.930496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330871c-691b-4710-890b-a64a50963a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:54.959384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8330871c-691b-4710-890b-a64a50963a08 None None] MFA Rules not processed for user `3988e4104ab644809a213bef20994b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:54.961605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8330871c-691b-4710-890b-a64a50963a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:55.060508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1163/2339] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:55.072984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:55.077089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:55.185331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab173edb-9983-4c28-a7f7-e6bda0b2d2d6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:55.190041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcde7-8112-4ef4-bdbe-da0a8368ebad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:55.190522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcde7-8112-4ef4-bdbe-da0a8368ebad service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:55.190913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcde7-8112-4ef4-bdbe-da0a8368ebad service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:55.191297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcde7-8112-4ef4-bdbe-da0a8368ebad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:55.232811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcde7-8112-4ef4-bdbe-da0a8368ebad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:55.234411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcde7-8112-4ef4-bdbe-da0a8368ebad service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:55.247285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1177/2340] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:55.700057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330871c-691b-4710-890b-a64a50963a08 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:55.777406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330871c-691b-4710-890b-a64a50963a08 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:55.782198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:55.783728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:55.783728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:55.783728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] PATH_INFO: `/v3/users/89440dfaf3c44af99300b4ff3e4feefd` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:55.785187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89440dfaf3c44af99300b4ff3e4feefd)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:55.787215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:55.845136 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:55.848370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89440dfaf3c44af99300b4ff3e4feefd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:55.849449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89440dfaf3c44af99300b4ff3e4feefd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:55.850510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89440dfaf3c44af99300b4ff3e4feefd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:55.865096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89440dfaf3c44af99300b4ff3e4feefd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:55.873933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89440dfaf3c44af99300b4ff3e4feefd'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:55.890131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1164/2341] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:55 2022] DELETE /identity/v3/users/89440dfaf3c44af99300b4ff3e4feefd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:55.894593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:55.894889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:55.895169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:55.913132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:55.914916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:55.975811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1178/2342] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:55.985736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:55.987146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:56.050467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754bd6c-dd09-4056-91ae-9637eea2e5b5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:56.054200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:56.054952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:56.055236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:56.055512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:56.065841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:56.067304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:56.078680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1165/2343] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:56.668712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:56.670310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:56.747512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:56.749441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:56.765908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925100e-35aa-45ec-b580-adcd7b0dc450 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:56.772006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:56.773713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:56.774215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:56.774706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] PATH_INFO: `/v3/projects/6e66ad647a7e41fe80bc8088161c3746` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:56.777088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e66ad647a7e41fe80bc8088161c3746)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:56.779881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:56.802031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e65cf-0e68-4b2f-ae78-e15e30428994 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:56.810397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:56.812161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:56.812607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:56.813083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:56.814944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:56.829997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:56.831910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:56.843689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1179/2344] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:56.853222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e66ad647a7e41fe80bc8088161c3746', 'request_id': 'req-df26dbdc-4736-4112-a540-a815b92bc88f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:56.864249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e66ad647a7e41fe80bc8088161c3746', 'request_id': 'req-df26dbdc-4736-4112-a540-a815b92bc88f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:56.883975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e66ad647a7e41fe80bc8088161c3746', 'request_id': 'req-df26dbdc-4736-4112-a540-a815b92bc88f'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:56.903599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] The token cache is being invalidate because project 6e66ad647a7e41fe80bc8088161c3746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:14:56.904019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:56.904828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:56.908768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1166/2345] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:14:56 2022] DELETE /identity/v3/projects/6e66ad647a7e41fe80bc8088161c3746 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:14:56.911042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:56.922668 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74419-b1db-4edd-90da-504da57477d1 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:56.952021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:57.017751 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:57.020403 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.020801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.021164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] PATH_INFO: `/v3/users/3988e4104ab644809a213bef20994b8a` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.025185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3988e4104ab644809a213bef20994b8a)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:57.027244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:57.111261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3988e4104ab644809a213bef20994b8a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.122173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3988e4104ab644809a213bef20994b8a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.123044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3988e4104ab644809a213bef20994b8a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.140582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3988e4104ab644809a213bef20994b8a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.152701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55d6254f-c64f-499b-8aa2-725a68212791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3988e4104ab644809a213bef20994b8a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.161878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1180/2346] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:56 2022] DELETE /identity/v3/users/3988e4104ab644809a213bef20994b8a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:57.466295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:57.468073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:57.482431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26dbdc-4736-4112-a540-a815b92bc88f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:57.537911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:57.556563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:57.557823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.558112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.558410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] PATH_INFO: `/v3/projects/791e65da83a34c12a6153f3ac478ce0c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.559648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=791e65da83a34c12a6153f3ac478ce0c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:57.562071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:57.617931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791e65da83a34c12a6153f3ac478ce0c', 'request_id': 'req-659281af-4fcb-410e-a3b9-eea7dd4a5eca'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.626284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791e65da83a34c12a6153f3ac478ce0c', 'request_id': 'req-659281af-4fcb-410e-a3b9-eea7dd4a5eca'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.634320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791e65da83a34c12a6153f3ac478ce0c', 'request_id': 'req-659281af-4fcb-410e-a3b9-eea7dd4a5eca'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.649314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] The token cache is being invalidate because project 791e65da83a34c12a6153f3ac478ce0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:14:57.649694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.650721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-659281af-4fcb-410e-a3b9-eea7dd4a5eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:57.655751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1167/2347] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:14:57 2022] DELETE /identity/v3/projects/791e65da83a34c12a6153f3ac478ce0c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:57.657549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.657847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.658131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.678167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:57.680642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:57.750615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1181/2348] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:57.758902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.759198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.759479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.780725 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:57.781994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:57.796798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1168/2349] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:57.797994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:57.810802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e778a-a13a-4823-8cad-3809a5c6010d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:57.816410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:57.817118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.817539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.817841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.818584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:14:57.818943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:57.821396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:57.834720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1182/2350] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:14:57.839341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:57.850014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632e7e-3597-435f-93dd-ad67d5ff37ab None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:57.854916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:57.855619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.856017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.856298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.857059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:57.858957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:57.889544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1169/2351] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:57 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:57.891065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:57.901813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7aaf-f78b-4ca9-9a02-6ba8ecbf8322 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:57.938918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:57.966577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:57.967255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:57.967542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:57.967946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:57.968641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:57.970629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:57.994054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1183/2352] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:57 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:57.995304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.005633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90662b8-67bb-411f-b372-5737d3d0a62f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.010958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.011622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.011898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.012169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.012953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.014564 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.025301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1170/2353] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:58.029222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.039714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ef3d-58f6-4df8-9804-b43d958ef091 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.044648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a150759-586e-47be-adf8-3296b7d80986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.045340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a150759-586e-47be-adf8-3296b7d80986 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.045631 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a150759-586e-47be-adf8-3296b7d80986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.045911 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a150759-586e-47be-adf8-3296b7d80986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.046640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a150759-586e-47be-adf8-3296b7d80986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.048253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a150759-586e-47be-adf8-3296b7d80986 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.062800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1184/2354] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:58.064101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.075100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185e326-f1bc-4e4e-8571-6fa4f0ffb3fe admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.079902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.080825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.081110 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.081390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] PATH_INFO: `/v3/projects/c851e5e3cdaf4dd9a37656e70e62a4dd/users/e05f51af73b446cdb9e5fd5d8fb73f49/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.096642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c851e5e3cdaf4dd9a37656e70e62a4dd, user_id=e05f51af73b446cdb9e5fd5d8fb73f49, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.099440 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.113611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1171/2355] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:58 2022] PUT /identity/v3/projects/c851e5e3cdaf4dd9a37656e70e62a4dd/users/e05f51af73b446cdb9e5fd5d8fb73f49/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:58.126811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.127125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.127400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.155138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] MFA Rules not processed for user `e05f51af73b446cdb9e5fd5d8fb73f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:58.156379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:58.229592 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1185/2356] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:58.233951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.298897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e762ca-580d-4ec9-b2d1-6961c73c7a43 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.303644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.305137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.305412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.305682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.306382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.308317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.330197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:58.342228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1172/2357] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:14:58 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:58.346090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.357029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1040-ad17-4e99-97fd-7c7e1151dc81 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.416140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.416759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.417048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.417330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.418031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.420489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.445305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1186/2358] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:14:58 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:14:58.446933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.457641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9cccf-cbf5-4baf-85e7-53c3f5fef047 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.462960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.463627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.463913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.464193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.464963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.466645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.481328 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1173/2359] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:58.482497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.494527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f4ac5-aa72-46b3-b33f-808c0ad627bf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.499910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.500847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.501134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.501414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] PATH_INFO: `/v3/projects/6b59f82a59554f178e3fb05399cb1756/users/a24f840643834d479939117ce1e2d6df/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.520909 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b59f82a59554f178e3fb05399cb1756, user_id=a24f840643834d479939117ce1e2d6df, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.524263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.539522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1187/2360] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:58 2022] PUT /identity/v3/projects/6b59f82a59554f178e3fb05399cb1756/users/a24f840643834d479939117ce1e2d6df/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:58.543529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.555182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d62e5-66f3-4a88-9caf-6c1ae0bbf38e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.611925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4421212-7cd8-4795-aedf-5676d7886946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.612608 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421212-7cd8-4795-aedf-5676d7886946 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.612940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421212-7cd8-4795-aedf-5676d7886946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.613223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421212-7cd8-4795-aedf-5676d7886946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.613980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4421212-7cd8-4795-aedf-5676d7886946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.615619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4421212-7cd8-4795-aedf-5676d7886946 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.626422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1174/2361] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:14:58.630525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.642133 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd060f9-b31a-40f8-8f31-05bb5e250a24 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.646870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.648562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.648879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.649159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] PATH_INFO: `/v3/projects/6b59f82a59554f178e3fb05399cb1756/users/a24f840643834d479939117ce1e2d6df/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.651256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b59f82a59554f178e3fb05399cb1756, user_id=a24f840643834d479939117ce1e2d6df, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.653999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.657962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:58.669429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1188/2362] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:14:58 2022] PUT /identity/v3/projects/6b59f82a59554f178e3fb05399cb1756/users/a24f840643834d479939117ce1e2d6df/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:58.680960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.681194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.681466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.715541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] MFA Rules not processed for user `a24f840643834d479939117ce1e2d6df`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:58.717034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:58.842995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1175/2363] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:14:58.857452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:58.860024 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:58.946850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577abb1-2df7-4ca1-8c8a-64b8275c0980 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:58.950799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986ed00-5a29-402c-8743-567401cfd2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:58.951456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986ed00-5a29-402c-8743-567401cfd2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:58.951745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986ed00-5a29-402c-8743-567401cfd2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:58.952055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986ed00-5a29-402c-8743-567401cfd2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:58.963254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986ed00-5a29-402c-8743-567401cfd2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:58.964864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986ed00-5a29-402c-8743-567401cfd2e3 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:58.974924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1189/2364] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:59.003869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:59.080622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6af7-191a-40db-934e-0f97c4738e49 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:59.086393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:59.087632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:59.087632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:59.087846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] PATH_INFO: `/v3/users/e05f51af73b446cdb9e5fd5d8fb73f49` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:59.089101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05f51af73b446cdb9e5fd5d8fb73f49)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:59.091259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:59.107224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:14:59.156963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05f51af73b446cdb9e5fd5d8fb73f49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.157699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05f51af73b446cdb9e5fd5d8fb73f49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.158453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05f51af73b446cdb9e5fd5d8fb73f49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.174145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05f51af73b446cdb9e5fd5d8fb73f49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.181611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05f51af73b446cdb9e5fd5d8fb73f49'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.200142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1176/2365] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:59 2022] DELETE /identity/v3/users/e05f51af73b446cdb9e5fd5d8fb73f49 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:59.205551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:59.205844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:59.206135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:59.228865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:14:59.230094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:59.301960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1190/2366] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:14:59.312801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:59.314246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:59.378319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02277-6c27-4e2c-8b01-ba52db7f08a1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:59.382925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:59.383587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:59.383875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:59.384157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:59.395550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:59.397846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:59.408888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1177/2367] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:14:59.862139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:14:59.863960 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:14:59.878895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06140941-9924-49c2-9725-18a70475cbb4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:14:59.886267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:14:59.887863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:14:59.888250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:14:59.888628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] PATH_INFO: `/v3/projects/c851e5e3cdaf4dd9a37656e70e62a4dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:14:59.890179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c851e5e3cdaf4dd9a37656e70e62a4dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:14:59.892912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:14:59.953705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c851e5e3cdaf4dd9a37656e70e62a4dd', 'request_id': 'req-38711851-968e-44c7-b167-3c10555eecb7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.959596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c851e5e3cdaf4dd9a37656e70e62a4dd', 'request_id': 'req-38711851-968e-44c7-b167-3c10555eecb7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.966335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c851e5e3cdaf4dd9a37656e70e62a4dd', 'request_id': 'req-38711851-968e-44c7-b167-3c10555eecb7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.983448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] The token cache is being invalidate because project c851e5e3cdaf4dd9a37656e70e62a4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:14:59.984263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.984389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:14:59.986150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1191/2368] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:14:59 2022] DELETE /identity/v3/projects/c851e5e3cdaf4dd9a37656e70e62a4dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:14:59.989889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:00.001188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b38b-2189-4737-b757-dae536e93a18 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:00.070595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:00.071586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:00.072065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:00.072414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] PATH_INFO: `/v3/users/a24f840643834d479939117ce1e2d6df` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:00.073742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24f840643834d479939117ce1e2d6df)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:00.075901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:00.118030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:00.135025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24f840643834d479939117ce1e2d6df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:00.136265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24f840643834d479939117ce1e2d6df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:00.136627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24f840643834d479939117ce1e2d6df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:00.154469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24f840643834d479939117ce1e2d6df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:00.163026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-b012ef41-1c13-4b91-9d5f-feb5b8ac5fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24f840643834d479939117ce1e2d6df'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:00.186631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1178/2369] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:14:59 2022] DELETE /identity/v3/users/a24f840643834d479939117ce1e2d6df => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:00.979261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:00.981344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:01.011235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711851-968e-44c7-b167-3c10555eecb7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.036970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:01.087396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.088634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.089006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.090416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] PATH_INFO: `/v3/projects/6b59f82a59554f178e3fb05399cb1756` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.091788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b59f82a59554f178e3fb05399cb1756)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.095932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.160876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b59f82a59554f178e3fb05399cb1756', 'request_id': 'req-92cd5843-b463-4411-af59-77e96a7ca1f4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:01.168890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b59f82a59554f178e3fb05399cb1756', 'request_id': 'req-92cd5843-b463-4411-af59-77e96a7ca1f4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:01.175661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b59f82a59554f178e3fb05399cb1756', 'request_id': 'req-92cd5843-b463-4411-af59-77e96a7ca1f4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:01.191105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] The token cache is being invalidate because project 6b59f82a59554f178e3fb05399cb1756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:01.191463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:01.192198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92cd5843-b463-4411-af59-77e96a7ca1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:01.194462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1192/2370] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:00 2022] DELETE /identity/v3/projects/6b59f82a59554f178e3fb05399cb1756 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:01.199523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655f85f-e3fe-463e-b752-cfe8cb9a276b None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.200042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655f85f-e3fe-463e-b752-cfe8cb9a276b None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.200141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655f85f-e3fe-463e-b752-cfe8cb9a276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.221045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-7655f85f-e3fe-463e-b752-cfe8cb9a276b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:01.222584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7655f85f-e3fe-463e-b752-cfe8cb9a276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:01.298726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1179/2371] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:01.307618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.308092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.308829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.310374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.310739 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.311371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.329931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:01.331318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:01.333453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:01.335505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:01.346948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1193/2372] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:15:01.351827 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.361887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ebcc4-0cbe-4859-a3af-c8bb0b3715e3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.367517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.367860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.368134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.368783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.369508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:15:01.369997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.371752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.388120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1194/2373] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:15:01.392835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.403464 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879dbd-b0a9-4a61-9e96-5a7831ce052e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.404347 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1180/2374] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:01.412616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.414644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.415095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.416239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.417122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.419282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.455567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1195/2375] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/projects => generated 409 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:01.456735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.458224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:01.459399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.525559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:01.531001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df977206-5f0d-44fd-a4ab-838c5e9d57ea admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.539038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.540374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.540374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.540580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.541338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.543561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.550015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54a01a-0f39-456f-8aec-334b1625cf67 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.562497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:01.568458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1196/2376] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/users => generated 305 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:15:01.572489 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.583281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bfb21-2b5e-438a-997e-9aa518074d02 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.590022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.590698 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.590980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.591324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.592060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.593689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.605129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1197/2377] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:15:01.609014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.620249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940845-914f-41e0-99d8-a8b2d14d6d66 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.625251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.625918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.626208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.626491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.627556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.628800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.630418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.632853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.633190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.633848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.644852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1198/2378] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:15:01.649824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.662336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b755f-82a5-4ffc-9628-bebb22e7de8e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.668288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d058-06ca-4159-9cf2-78967ffbce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.669281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d058-06ca-4159-9cf2-78967ffbce96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.669572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d058-06ca-4159-9cf2-78967ffbce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.669918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d058-06ca-4159-9cf2-78967ffbce96 admin admin] PATH_INFO: `/v3/projects/5c01a4bb714540099dd25db54af2f493/users/452f330ee6694167b18c56891882446b/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.703065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d058-06ca-4159-9cf2-78967ffbce96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c01a4bb714540099dd25db54af2f493, user_id=452f330ee6694167b18c56891882446b, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.705921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d058-06ca-4159-9cf2-78967ffbce96 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.725516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1199/2379] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:01 2022] PUT /identity/v3/projects/5c01a4bb714540099dd25db54af2f493/users/452f330ee6694167b18c56891882446b/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:01.736912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7c38-b053-4163-a688-dee409aad3af None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.737277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7c38-b053-4163-a688-dee409aad3af None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.737565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7c38-b053-4163-a688-dee409aad3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.750972 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.752612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:01.762992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1181/2380] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:15:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:15:01.779844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-565e7c38-b053-4163-a688-dee409aad3af None None] MFA Rules not processed for user `452f330ee6694167b18c56891882446b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:01.782142 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-565e7c38-b053-4163-a688-dee409aad3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:01.880718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1200/2381] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:01.884751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:01.898589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a267f2-ff80-42c1-8e78-549a74f2b7eb service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:01.970053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:01.970937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:01.971366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:01.971704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:01.972987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:01.974957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.013275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1182/2382] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:15:01 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:02.018158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e7c38-b053-4163-a688-dee409aad3af None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:02.032375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e7c38-b053-4163-a688-dee409aad3af None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:02.124257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:02.125357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.125832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.126296 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.127233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:02.129722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.160969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1201/2383] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:15:02 2022] POST /identity/v3/users => generated 310 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:15:02.162767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:02.180727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92db93-86e1-4531-91ce-10b9990b5d29 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:02.186170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:02.186919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.187279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.187712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.188482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:02.190358 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.205677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1183/2384] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:02.210652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:02.222194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b705-d344-4723-b4de-456773b07681 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:02.234956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:02.236276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.236809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.237317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] PATH_INFO: `/v3/projects/c09d638bc6bb407dad6f35a33d550006/users/1c4d451430dd473cb48bdaaa02aec00e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.265084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09d638bc6bb407dad6f35a33d550006, user_id=1c4d451430dd473cb48bdaaa02aec00e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:02.271711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.296720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1202/2385] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:02 2022] PUT /identity/v3/projects/c09d638bc6bb407dad6f35a33d550006/users/1c4d451430dd473cb48bdaaa02aec00e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:02.298687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:02.323096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d3929-0e78-4d1b-9bb7-b4b5fa90799e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:02.344839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:02.411096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25be8-4d09-4137-a00d-86af5ff1d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:02.412386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25be8-4d09-4137-a00d-86af5ff1d8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.413119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25be8-4d09-4137-a00d-86af5ff1d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.413607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25be8-4d09-4137-a00d-86af5ff1d8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.414642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25be8-4d09-4137-a00d-86af5ff1d8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:02.416485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25be8-4d09-4137-a00d-86af5ff1d8dd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.433949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1184/2386] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:15:02.434582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:02.447298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636fdcb-0d64-4919-81d1-5f6345bb5179 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:02.452447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:02.453703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.454549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.455045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] PATH_INFO: `/v3/projects/c09d638bc6bb407dad6f35a33d550006/users/1c4d451430dd473cb48bdaaa02aec00e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.457348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09d638bc6bb407dad6f35a33d550006, user_id=1c4d451430dd473cb48bdaaa02aec00e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:02.460397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.464151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:02.480921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1203/2387] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:02 2022] PUT /identity/v3/projects/c09d638bc6bb407dad6f35a33d550006/users/1c4d451430dd473cb48bdaaa02aec00e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:02.489330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331434a-cc10-4add-af06-763580e71809 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.489638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331434a-cc10-4add-af06-763580e71809 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.489921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331434a-cc10-4add-af06-763580e71809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.526174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f331434a-cc10-4add-af06-763580e71809 None None] MFA Rules not processed for user `1c4d451430dd473cb48bdaaa02aec00e`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:02.527970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f331434a-cc10-4add-af06-763580e71809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:02.622238 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1185/2388] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:02.634458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:02.636502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:02.722433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafd602-03d5-4b03-916d-470fdaed0efe admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:02.730292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:02.731443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:02.731922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:02.732393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:02.743193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:02.745624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:02.765876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1204/2389] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:03.021125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331434a-cc10-4add-af06-763580e71809 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:03.033443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331434a-cc10-4add-af06-763580e71809 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:03.037729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404d1a-b276-41e7-a133-f634b3673b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:03.039083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404d1a-b276-41e7-a133-f634b3673b94 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:03.039455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404d1a-b276-41e7-a133-f634b3673b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:03.040277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404d1a-b276-41e7-a133-f634b3673b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:03.163791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d404d1a-b276-41e7-a133-f634b3673b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:03.165959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d404d1a-b276-41e7-a133-f634b3673b94 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:03.182282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1186/2390] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:15:12.329596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:12.393434 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae325b7-3e73-493d-9c8a-3458dc3b3a21 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:12.398045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:12.398915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:12.399201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:12.399479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] PATH_INFO: `/v3/users/452f330ee6694167b18c56891882446b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:12.400667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] RBAC: Authorizing `identity:delete_user(user_id=452f330ee6694167b18c56891882446b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:12.402649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:12.456815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452f330ee6694167b18c56891882446b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:12.465599 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452f330ee6694167b18c56891882446b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:12.466353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452f330ee6694167b18c56891882446b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:12.478919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452f330ee6694167b18c56891882446b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:12.485636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452f330ee6694167b18c56891882446b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:12.492423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1205/2391] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:15:12 2022] DELETE /identity/v3/users/452f330ee6694167b18c56891882446b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:12.497083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:12.497556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:12.497653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:12.514638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:12.515853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:12.545772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:12.576732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1187/2392] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:12.586402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:12.587805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:12.608514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:12.651970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533b0b-ae53-4a46-9782-8b804fb3177e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:12.655595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:12.656226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:12.656506 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:12.656809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:12.666138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:12.667591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:12.679148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1206/2393] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:15:12.946937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:12.948524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:12.962888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5942-599b-41d8-8b9a-9a9371808017 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:12.967845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:12.968786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:12.969074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:12.969357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] PATH_INFO: `/v3/projects/5c01a4bb714540099dd25db54af2f493` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:12.970591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c01a4bb714540099dd25db54af2f493)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:12.972551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:13.022441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c01a4bb714540099dd25db54af2f493', 'request_id': 'req-aeed5193-106d-4afe-b0b6-958729a979e3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.030784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c01a4bb714540099dd25db54af2f493', 'request_id': 'req-aeed5193-106d-4afe-b0b6-958729a979e3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.037286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c01a4bb714540099dd25db54af2f493', 'request_id': 'req-aeed5193-106d-4afe-b0b6-958729a979e3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.048518 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] The token cache is being invalidate because project 5c01a4bb714540099dd25db54af2f493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:13.048840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.049489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.051044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1188/2394] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:12 2022] DELETE /identity/v3/projects/5c01a4bb714540099dd25db54af2f493 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:13.054934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:13.064699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1441eea-767f-4274-a128-f8a44425398d service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:13.126942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:13.127849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.128116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.128382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] PATH_INFO: `/v3/users/1c4d451430dd473cb48bdaaa02aec00e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.129603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4d451430dd473cb48bdaaa02aec00e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:13.131635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:13.184167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4d451430dd473cb48bdaaa02aec00e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.193000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4d451430dd473cb48bdaaa02aec00e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.193539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4d451430dd473cb48bdaaa02aec00e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.207318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4d451430dd473cb48bdaaa02aec00e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.216170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-85ab351a-8d5a-40e3-9f1a-c0b2ce6d89d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4d451430dd473cb48bdaaa02aec00e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.222304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1207/2395] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:15:13 2022] DELETE /identity/v3/users/1c4d451430dd473cb48bdaaa02aec00e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:13.501616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:13.503103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:13.524058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5193-106d-4afe-b0b6-958729a979e3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:13.584732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:13.585927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.586326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.586692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] PATH_INFO: `/v3/projects/c09d638bc6bb407dad6f35a33d550006` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.588264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09d638bc6bb407dad6f35a33d550006)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:13.590986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:13.639122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09d638bc6bb407dad6f35a33d550006', 'request_id': 'req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.646020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09d638bc6bb407dad6f35a33d550006', 'request_id': 'req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.648242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:13.652975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09d638bc6bb407dad6f35a33d550006', 'request_id': 'req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.664493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] The token cache is being invalidate because project c09d638bc6bb407dad6f35a33d550006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:13.664814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.665447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5e3a3d70-f7ee-4634-9637-8bae92fff8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:13.666954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1189/2396] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:13 2022] DELETE /identity/v3/projects/c09d638bc6bb407dad6f35a33d550006 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:13.672418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.672951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.673074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.691421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:13.692604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:13.726801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:13.755181 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1208/2397] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:13.764017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.764307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.764585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.783068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:13.784263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:13.792556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1190/2398] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:13.796714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:13.807411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3320-5f73-4ceb-97f3-52bb70ca47fe None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:13.812662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:13.813180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.813458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.813718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.814443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:15:13.814747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:13.816353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:13.829836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1209/2399] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:15:13.834268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:13.843767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc45ad1-831e-4f5f-adba-d6502023cb52 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:13.848410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:13.849084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.849363 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.849699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.850647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:13.852560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:13.878181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1191/2400] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:15:13 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:13.883060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:13.893012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69becaf-340d-4518-a578-fd0700777073 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:13.953254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:13.953929 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.954215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:13.954491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:13.955433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:13.957130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:13.981825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1210/2401] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:15:13 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:13.983107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:13.994168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfed7f-e6c0-4968-91eb-5b149dc15f18 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:13.998985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:13.999655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:13.999978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.000265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.001030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.002667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.013741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1192/2402] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:14.017760 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.028777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ae157-27ec-43d2-b6a1-074b660f67b3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.033627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745563b-2619-4d28-a43b-3d122fa2a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.034293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745563b-2619-4d28-a43b-3d122fa2a12a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.035122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745563b-2619-4d28-a43b-3d122fa2a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.035122 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745563b-2619-4d28-a43b-3d122fa2a12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.035571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745563b-2619-4d28-a43b-3d122fa2a12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.037275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745563b-2619-4d28-a43b-3d122fa2a12a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.048738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1211/2403] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:15:14.054029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.064298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8ebcc-dbbc-4db7-8f49-5d4c978e5b45 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.069186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.070068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.070346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.070617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] PATH_INFO: `/v3/projects/5e75f768a98d4eecb161aa31b26fcdf8/users/9f47ca195ab54c979c47776e62fd156a/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.086988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e75f768a98d4eecb161aa31b26fcdf8, user_id=9f47ca195ab54c979c47776e62fd156a, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.089727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.110988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1193/2404] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:14 2022] PUT /identity/v3/projects/5e75f768a98d4eecb161aa31b26fcdf8/users/9f47ca195ab54c979c47776e62fd156a/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:15:14.116503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.117067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.117360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.144415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] MFA Rules not processed for user `9f47ca195ab54c979c47776e62fd156a`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:14.145593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:14.210866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1212/2405] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:15:14.215305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.276449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afeb1d-a1bd-49cd-9716-a6d092af37d4 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.281159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.281812 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.282099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.282379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.283070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.286698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.313239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1194/2406] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:15:14 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:14.317054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.328022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68602c3e-db63-4040-a009-24c22a5dc0e9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.362360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:14.388954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.389626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.389915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.390190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.390877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.392848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.414845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1213/2407] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:15:14 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:14.418986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.430527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ed21e-418c-448c-8b27-9daea856b95a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.437481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.437792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.438167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.438419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.439162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.440860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.452713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1195/2408] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:14.456738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.467917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a32c0a-4850-43db-b97d-cd9badc1cd36 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.473663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79040286-b249-4902-9547-9a9e62b89ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.474368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79040286-b249-4902-9547-9a9e62b89ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.474653 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79040286-b249-4902-9547-9a9e62b89ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.475002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79040286-b249-4902-9547-9a9e62b89ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.476517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79040286-b249-4902-9547-9a9e62b89ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.478263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79040286-b249-4902-9547-9a9e62b89ad0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.489226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1214/2409] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:15:14.493752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.504963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898ed89-afe3-402b-be33-2468ebbdf0fa admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.510581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.511473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.511748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.512016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] PATH_INFO: `/v3/projects/d8b3756d59014c789a08955bf783b0dc/users/6d4f65f7bb1c4249a74683d73e93297c/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.528575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b3756d59014c789a08955bf783b0dc, user_id=6d4f65f7bb1c4249a74683d73e93297c, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.531276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.544693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1196/2410] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:14 2022] PUT /identity/v3/projects/d8b3756d59014c789a08955bf783b0dc/users/6d4f65f7bb1c4249a74683d73e93297c/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:15:14.555849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.556153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.556436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.587308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] MFA Rules not processed for user `6d4f65f7bb1c4249a74683d73e93297c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:14.588566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:14.651976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1215/2411] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:14.656497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.691925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:14.721278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8cd0b-88b3-47d8-94fa-ece8e4e0f1a1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.726049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.726705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.726992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.727267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.727945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.729910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.754476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1197/2412] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:15:14 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:14.759493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.770497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969ff02-6740-4d81-af29-b29e2869f6ca None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.832281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.833095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.833461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.833738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.835069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.837249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.856553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1216/2413] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:15:14 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:14.860484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.870981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63391452-c39e-4414-ba3b-0f41de84991d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.875643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.876299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.876584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.876892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.877651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.879253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.890230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1198/2414] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:14.894240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.904662 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d005-0d85-4dfb-8057-3cc5cbffcd96 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:14.909265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:14.910125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:14.910411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:14.910689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] PATH_INFO: `/v3/projects/f47e6ba00f424e0f8e90535ac0d92881/users/60f71756e4014b3a8d3fec61dcc6f20d/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:14.926598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47e6ba00f424e0f8e90535ac0d92881, user_id=60f71756e4014b3a8d3fec61dcc6f20d, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:14.929910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:14.942513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1217/2415] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:14 2022] PUT /identity/v3/projects/f47e6ba00f424e0f8e90535ac0d92881/users/60f71756e4014b3a8d3fec61dcc6f20d/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:14.947003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:14.957000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420977a6-8846-4ab0-be1b-40cd00c94144 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:15.012695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89303462-b281-4ba4-90f1-30b87cc8a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:15.013371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89303462-b281-4ba4-90f1-30b87cc8a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:15.013651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89303462-b281-4ba4-90f1-30b87cc8a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:15.013923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89303462-b281-4ba4-90f1-30b87cc8a7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:15.014639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89303462-b281-4ba4-90f1-30b87cc8a7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:15.016254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89303462-b281-4ba4-90f1-30b87cc8a7b1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:15.026656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1199/2416] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:15.030710 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:15.041065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edf56-5942-4060-88f6-982c66d04647 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:15.045727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:15.046607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:15.046886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:15.047160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] PATH_INFO: `/v3/projects/f47e6ba00f424e0f8e90535ac0d92881/users/60f71756e4014b3a8d3fec61dcc6f20d/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:15.049170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47e6ba00f424e0f8e90535ac0d92881, user_id=60f71756e4014b3a8d3fec61dcc6f20d, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:15.051855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:15.055567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:15.064249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1218/2417] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:15 2022] PUT /identity/v3/projects/f47e6ba00f424e0f8e90535ac0d92881/users/60f71756e4014b3a8d3fec61dcc6f20d/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:15.074962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:15.075263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:15.075544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:15.103092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] MFA Rules not processed for user `60f71756e4014b3a8d3fec61dcc6f20d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:15.104302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:15.182671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1200/2418] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:15.195117 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:15.196636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:15.274542 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96aa43-a505-4dcd-8544-156e9faaca3c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:15.279255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c63086-2878-4d21-9016-e7a8d2623f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:15.279902 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63086-2878-4d21-9016-e7a8d2623f40 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:15.280288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63086-2878-4d21-9016-e7a8d2623f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:15.280580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63086-2878-4d21-9016-e7a8d2623f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:15.290235 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c63086-2878-4d21-9016-e7a8d2623f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:15.291752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c63086-2878-4d21-9016-e7a8d2623f40 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:15.301831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1219/2419] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:15.345476 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:15.346875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:15.359353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0510d-f1f4-4652-9098-f39bb155b5bb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:15.363019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b83cdf-052b-4d19-838b-d52198f9f974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:15.363668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83cdf-052b-4d19-838b-d52198f9f974 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:15.363951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83cdf-052b-4d19-838b-d52198f9f974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:15.364228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83cdf-052b-4d19-838b-d52198f9f974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:15.392489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:15.435198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b83cdf-052b-4d19-838b-d52198f9f974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:15.436926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b83cdf-052b-4d19-838b-d52198f9f974 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:15.447738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1201/2420] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:16.247981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f230c-466d-4fe4-9f2d-97b07633e0d5 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.248646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f230c-466d-4fe4-9f2d-97b07633e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.248646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f230c-466d-4fe4-9f2d-97b07633e0d5 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.250029 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1220/2421] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:15:16.256754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da656a93-88fd-4927-8136-3726a29cfc34 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.257242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da656a93-88fd-4927-8136-3726a29cfc34 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.257411 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da656a93-88fd-4927-8136-3726a29cfc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.275045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-da656a93-88fd-4927-8136-3726a29cfc34 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:16.276402 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-da656a93-88fd-4927-8136-3726a29cfc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:16.346122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1202/2422] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:15:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:15:16.357933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f230c-466d-4fe4-9f2d-97b07633e0d5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:16.359613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-510f230c-466d-4fe4-9f2d-97b07633e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:16.419490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f230c-466d-4fe4-9f2d-97b07633e0d5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:16.423159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4256ed-b321-4a38-a47d-2bc3c3c8740e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:16.423803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4256ed-b321-4a38-a47d-2bc3c3c8740e service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.424089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4256ed-b321-4a38-a47d-2bc3c3c8740e service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.424368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4256ed-b321-4a38-a47d-2bc3c3c8740e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.435102 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4256ed-b321-4a38-a47d-2bc3c3c8740e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:16.436819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4256ed-b321-4a38-a47d-2bc3c3c8740e service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:16.447594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1221/2423] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:16.515083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44a39-d657-4f36-8cf7-35bed2b87bd3 None None] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.515379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44a39-d657-4f36-8cf7-35bed2b87bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.515685 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44a39-d657-4f36-8cf7-35bed2b87bd3 None None] PATH_INFO: `/` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.517129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1203/2424] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:15:16.522017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1230-34bc-4efd-90cb-c9c6d55b3f0b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.522313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1230-34bc-4efd-90cb-c9c6d55b3f0b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.522624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1230-34bc-4efd-90cb-c9c6d55b3f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.541786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-119b1230-34bc-4efd-90cb-c9c6d55b3f0b None None] MFA Rules not processed for user `722c501d471d402b9b7eb5879b103ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:16.542932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-119b1230-34bc-4efd-90cb-c9c6d55b3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:16.597748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1222/2425] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:15:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:16.610042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44a39-d657-4f36-8cf7-35bed2b87bd3 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:16.611757 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-86a44a39-d657-4f36-8cf7-35bed2b87bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:16.625668 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44a39-d657-4f36-8cf7-35bed2b87bd3 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:16.629210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da3aa5-5b06-4bf4-a8f8-779bb480ae75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:16.629842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da3aa5-5b06-4bf4-a8f8-779bb480ae75 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.630122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da3aa5-5b06-4bf4-a8f8-779bb480ae75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.630395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da3aa5-5b06-4bf4-a8f8-779bb480ae75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.637888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da3aa5-5b06-4bf4-a8f8-779bb480ae75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:16.639327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da3aa5-5b06-4bf4-a8f8-779bb480ae75 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:16.647910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1204/2426] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:16.730279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e61861-96b4-419c-885b-bda2f8e28e20 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.730570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e61861-96b4-419c-885b-bda2f8e28e20 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.730846 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e61861-96b4-419c-885b-bda2f8e28e20 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.732199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1223/2427] 10.222.0.31 () {54 vars in 921 bytes} [Wed May 25 17:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 17:15:16.737105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.737398 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.737677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.756913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] MFA Rules not processed for user `600d472e73da4c96af486c16a3f7df81`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:16.758210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:16.767827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1205/2428] 10.222.0.31 () {58 vars in 1018 bytes} [Wed May 25 17:15:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:16.779051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e61861-96b4-419c-885b-bda2f8e28e20 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:16.780765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-52e61861-96b4-419c-885b-bda2f8e28e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:16.794580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e61861-96b4-419c-885b-bda2f8e28e20 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:16.798089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffbe27-b796-4f24-b775-930f1a2cd08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:16.798823 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffbe27-b796-4f24-b775-930f1a2cd08c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:16.798985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffbe27-b796-4f24-b775-930f1a2cd08c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:16.799735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffbe27-b796-4f24-b775-930f1a2cd08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:16.811336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffbe27-b796-4f24-b775-930f1a2cd08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:16.812861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffbe27-b796-4f24-b775-930f1a2cd08c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:16.824333 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1224/2429] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:15:18.442169 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:18.508042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275eea1-ab1c-4702-b5a7-8666842e6fd8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:18.512662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:18.513559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:18.513842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:18.514116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] PATH_INFO: `/v3/users/9f47ca195ab54c979c47776e62fd156a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:18.515299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f47ca195ab54c979c47776e62fd156a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:18.517293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:18.569700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:18.579733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f47ca195ab54c979c47776e62fd156a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:18.580774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f47ca195ab54c979c47776e62fd156a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:18.581532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f47ca195ab54c979c47776e62fd156a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:18.602135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f47ca195ab54c979c47776e62fd156a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:18.610306 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-05d0a15b-6258-4bac-90cc-ea06b503b6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f47ca195ab54c979c47776e62fd156a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:18.640166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1206/2430] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:15:18 2022] DELETE /identity/v3/users/9f47ca195ab54c979c47776e62fd156a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:18.640603 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:18.641442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:18.641891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:18.642284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:18.642680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:18.643017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:18.666262 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:18.667726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:18.669184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:18.670297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:18.712650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:18.755292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1225/2431] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:15:18.758224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1207/2432] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:18.764615 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:18.766581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:18.768938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:18.770589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:18.864224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff619c0-3089-492d-bffc-76d10aec0b86 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:18.873592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:18.874536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:18.875060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:18.875710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:18.886279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5e73-c037-4d9c-b410-5b5b95726e7f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:18.889385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:18.891181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:18.891852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:18.892500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:18.892938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:18.893213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:18.902477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:18.904029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1208/2433] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:18.904227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:18.915147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1226/2434] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:15:19.249731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:19.251976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:19.280574 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae8821-f92c-4d5a-a222-e49ced06120a service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:19.287403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:19.288307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:19.288589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:19.288895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] PATH_INFO: `/v3/projects/5e75f768a98d4eecb161aa31b26fcdf8` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:19.290116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e75f768a98d4eecb161aa31b26fcdf8)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:19.292558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:19.350961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e75f768a98d4eecb161aa31b26fcdf8', 'request_id': 'req-0faa9e4d-9a7f-406f-a233-9d158877e361'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.360546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e75f768a98d4eecb161aa31b26fcdf8', 'request_id': 'req-0faa9e4d-9a7f-406f-a233-9d158877e361'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.362108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:19.369524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e75f768a98d4eecb161aa31b26fcdf8', 'request_id': 'req-0faa9e4d-9a7f-406f-a233-9d158877e361'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.386978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] The token cache is being invalidate because project 5e75f768a98d4eecb161aa31b26fcdf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:19.387558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.388344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.390123 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1209/2435] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:19 2022] DELETE /identity/v3/projects/5e75f768a98d4eecb161aa31b26fcdf8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:19.394683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:19.411905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581af8f9-bb0e-4062-8029-a3f4d94f642b service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:19.491686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:19.492703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:19.493004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:19.493280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] PATH_INFO: `/v3/users/6d4f65f7bb1c4249a74683d73e93297c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:19.494502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4f65f7bb1c4249a74683d73e93297c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:19.496452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:19.552097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4f65f7bb1c4249a74683d73e93297c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.561930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4f65f7bb1c4249a74683d73e93297c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.562905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4f65f7bb1c4249a74683d73e93297c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.578951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4f65f7bb1c4249a74683d73e93297c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.581921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:19.590900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4f65f7bb1c4249a74683d73e93297c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:19.598224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1227/2436] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:15:19 2022] DELETE /identity/v3/users/6d4f65f7bb1c4249a74683d73e93297c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:19.938187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:19.939748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:19.960977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9e4d-9a7f-406f-a233-9d158877e361 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:20.056789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:20.057677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:20.057962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:20.058240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] PATH_INFO: `/v3/projects/d8b3756d59014c789a08955bf783b0dc` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:20.059797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b3756d59014c789a08955bf783b0dc)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:20.066089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:20.117778 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b3756d59014c789a08955bf783b0dc', 'request_id': 'req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.125709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b3756d59014c789a08955bf783b0dc', 'request_id': 'req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.133251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b3756d59014c789a08955bf783b0dc', 'request_id': 'req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.144315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] The token cache is being invalidate because project d8b3756d59014c789a08955bf783b0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:20.144862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.145590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.148109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1210/2437] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:19 2022] DELETE /identity/v3/projects/d8b3756d59014c789a08955bf783b0dc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:20.152164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:20.153793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:20.166864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0066370-9ba8-4464-a72b-f08f71d3179e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:20.230097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:20.231121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:20.231509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:20.231857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] PATH_INFO: `/v3/users/60f71756e4014b3a8d3fec61dcc6f20d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:20.233406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f71756e4014b3a8d3fec61dcc6f20d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:20.235458 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:20.316134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f71756e4014b3a8d3fec61dcc6f20d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.326465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f71756e4014b3a8d3fec61dcc6f20d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.328280 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f71756e4014b3a8d3fec61dcc6f20d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.344154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f71756e4014b3a8d3fec61dcc6f20d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.351922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-88d893b2-0e04-46a2-b9c0-104fc770a158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f71756e4014b3a8d3fec61dcc6f20d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.358540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1228/2438] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:15:20 2022] DELETE /identity/v3/users/60f71756e4014b3a8d3fec61dcc6f20d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:15:20.655514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:20.657120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:20.681745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39170b9-4dc7-4148-a7ce-f325c9cf1a3b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:20.749641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:20.750524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:20.750800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:20.751073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] PATH_INFO: `/v3/projects/f47e6ba00f424e0f8e90535ac0d92881` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:20.752316 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47e6ba00f424e0f8e90535ac0d92881)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:20.754730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:20.775072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:20.818069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47e6ba00f424e0f8e90535ac0d92881', 'request_id': 'req-4be5b077-142c-4426-a6a7-fe7948d875eb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.827507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47e6ba00f424e0f8e90535ac0d92881', 'request_id': 'req-4be5b077-142c-4426-a6a7-fe7948d875eb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.838361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47e6ba00f424e0f8e90535ac0d92881', 'request_id': 'req-4be5b077-142c-4426-a6a7-fe7948d875eb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.854047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] The token cache is being invalidate because project f47e6ba00f424e0f8e90535ac0d92881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:20.854340 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.854999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4be5b077-142c-4426-a6a7-fe7948d875eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:20.856543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1211/2439] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:20 2022] DELETE /identity/v3/projects/f47e6ba00f424e0f8e90535ac0d92881 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:20.863644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:20.863930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:20.864252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:20.883025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:20.884252 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:20.953056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1229/2440] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:20.962317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:20.962835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:20.962953 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:20.988825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:20.989985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:20.997968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1212/2441] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:21.002675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.015992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb903c-a276-4a4d-a442-77908b046755 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.021629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.022889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.023341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.023696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.024503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:15:21.024917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.026674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.034491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:21.041457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1230/2442] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:15:21.045690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.056070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bbd68-eb61-424b-b8b7-ca4488804a58 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.061698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.062382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.062874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.063158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.063876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.065842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.101753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1213/2443] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:15:21 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:15:21.105609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.116934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e1a03-db00-475b-a661-c341fddd7968 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.194030 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.202203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.204153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.204891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.207167 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.214418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.266315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1231/2444] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:15:21 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:15:21.267767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.282968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f617fd-7203-4145-b96d-391bbf0e52f7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.289885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.290881 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.291387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.291521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.292280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.294790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.310479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1214/2445] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:21.314591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.330425 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d930c-dfdb-419b-b612-f43363197892 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.335917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac71110-d5c5-4b71-9b7a-04bdecd07963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.336595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71110-d5c5-4b71-9b7a-04bdecd07963 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.336935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71110-d5c5-4b71-9b7a-04bdecd07963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.337208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71110-d5c5-4b71-9b7a-04bdecd07963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.337969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac71110-d5c5-4b71-9b7a-04bdecd07963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.339575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac71110-d5c5-4b71-9b7a-04bdecd07963 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.351536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1232/2446] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:15:21.355246 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.367717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e096d3-987b-40c7-a969-fa73de8c3ca8 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.372770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.373744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.374097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.374439 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] PATH_INFO: `/v3/projects/698832317d7248f3b1f06f03276985bb/users/1341cf2610a04f7abbef0ec5929ee52c/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.391338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698832317d7248f3b1f06f03276985bb, user_id=1341cf2610a04f7abbef0ec5929ee52c, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.394205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.409130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1215/2447] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:15:21 2022] PUT /identity/v3/projects/698832317d7248f3b1f06f03276985bb/users/1341cf2610a04f7abbef0ec5929ee52c/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:21.423932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.424376 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.424837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.455817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] MFA Rules not processed for user `1341cf2610a04f7abbef0ec5929ee52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:21.457079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:21.532507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1233/2448] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:21.546459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:21.548299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:21.611898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70841b19-5090-49a6-99b2-43633a117889 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:21.615855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c303a4f-7e4d-4339-8b8e-c141df4f314d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:21.616503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303a4f-7e4d-4339-8b8e-c141df4f314d service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:21.616824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303a4f-7e4d-4339-8b8e-c141df4f314d service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:21.617101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303a4f-7e4d-4339-8b8e-c141df4f314d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:21.626641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c303a4f-7e4d-4339-8b8e-c141df4f314d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:21.628099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c303a4f-7e4d-4339-8b8e-c141df4f314d service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:21.638455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1216/2449] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:24.282163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:24.351855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1d81e-d1f9-493f-98d1-573b26deec2b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:24.356513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:24.357423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:24.357714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:24.358182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] PATH_INFO: `/v3/users/1341cf2610a04f7abbef0ec5929ee52c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:24.359503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1341cf2610a04f7abbef0ec5929ee52c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:24.361498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:24.372797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:24.420824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1341cf2610a04f7abbef0ec5929ee52c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:24.429344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1341cf2610a04f7abbef0ec5929ee52c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:24.430083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1341cf2610a04f7abbef0ec5929ee52c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:24.445014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1341cf2610a04f7abbef0ec5929ee52c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:24.452099 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1341cf2610a04f7abbef0ec5929ee52c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:24.462035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1234/2450] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:15:24 2022] DELETE /identity/v3/users/1341cf2610a04f7abbef0ec5929ee52c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:15:24.464205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:24.464719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:24.464831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:24.482164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:24.483394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:24.528654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:24.566197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1217/2451] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:24.578334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:24.585449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:24.721867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55640cb6-ca7f-4e07-83b7-37dd5cedf129 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:24.726606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79bf3e-a6c3-40a5-9507-c4871241d61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:24.727467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79bf3e-a6c3-40a5-9507-c4871241d61f service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:24.727755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79bf3e-a6c3-40a5-9507-c4871241d61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:24.728036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79bf3e-a6c3-40a5-9507-c4871241d61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:24.741213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79bf3e-a6c3-40a5-9507-c4871241d61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:24.745160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79bf3e-a6c3-40a5-9507-c4871241d61f service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:24.758266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1235/2452] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:15:25.090780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:25.092693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:25.119522 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252993-4a54-4e26-9fcb-1ddbd9784a35 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:25.125083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:25.125820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:25.126101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:25.126372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] PATH_INFO: `/v3/projects/698832317d7248f3b1f06f03276985bb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:25.127582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698832317d7248f3b1f06f03276985bb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:25.130135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:25.184357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698832317d7248f3b1f06f03276985bb', 'request_id': 'req-68b184c9-6d70-45ed-ade7-96693fef6383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:25.192373 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698832317d7248f3b1f06f03276985bb', 'request_id': 'req-68b184c9-6d70-45ed-ade7-96693fef6383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:25.205338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698832317d7248f3b1f06f03276985bb', 'request_id': 'req-68b184c9-6d70-45ed-ade7-96693fef6383'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:25.217864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] The token cache is being invalidate because project 698832317d7248f3b1f06f03276985bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:15:25.218211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:25.218834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:15:25.221173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1218/2453] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:15:25 2022] DELETE /identity/v3/projects/698832317d7248f3b1f06f03276985bb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:15:34.753163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:34.962483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:34.962794 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:34.963071 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:34.980625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:15:34.981875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:35.037339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1236/2454] 10.222.0.31 () {58 vars in 967 bytes} [Wed May 25 17:15:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:15:35.049232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:15:35.050600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:15:35.118844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b184c9-6d70-45ed-ade7-96693fef6383 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:15:35.124023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:15:35.124690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:15:35.124985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:15:35.125265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:15:35.134012 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:15:35.135605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:15:35.143565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1219/2455] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:15:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:15:45.030359 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=25 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:15:45.140365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:03.910170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:03.912148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:03.970725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c0543-5669-443d-9841-35fe5f27faef None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:03.975177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:03.975971 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:03.976256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:03.976531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:03.978574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:04.041835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:04.043313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:04.053543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1237/2456] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:04.549979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:04.552146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:04.563915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf613f-ef1d-40cf-8de7-8d0eaf261ab9 service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:04.569197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:04.569832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:04.570109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:04.570379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:04.572095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:04.584652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:04.586119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:04.595986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1220/2457] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:07.494660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:07.496070 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:07.575317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058025-0eb7-4a50-b254-11cf42f86d64 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:07.580779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:07.581931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:07.582767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:07.583068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:07.585202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:07.594734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:07.597089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:07.599292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:07.600944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:07.611016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535f2f-520b-4aaf-8727-ea7ed46bb746 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:07.612303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1238/2458] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:07.616824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:07.617895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:07.618270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:07.618769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] PATH_INFO: `/v3/users/3fb5eecf3e244058905ea3aba8112320` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:07.620090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb5eecf3e244058905ea3aba8112320)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:07.623651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:07.691738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb5eecf3e244058905ea3aba8112320'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:07.692912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb5eecf3e244058905ea3aba8112320'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:07.694374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb5eecf3e244058905ea3aba8112320'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:07.712547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb5eecf3e244058905ea3aba8112320'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:07.726301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ddaf87d0-2a45-4d04-b1b3-f037c450ff05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb5eecf3e244058905ea3aba8112320'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:07.742862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1221/2459] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:07 2022] DELETE /identity/v3/users/3fb5eecf3e244058905ea3aba8112320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:08.160447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.174724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a0bad-d050-4964-ace2-3aefdef6e77a service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.265173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:08.288246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.289555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.289847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.290129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] PATH_INFO: `/v3/projects/6ad0c3cc9eaf41c09d6b967a2fa49900` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.291365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad0c3cc9eaf41c09d6b967a2fa49900)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.293364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.358841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'request_id': 'req-d967aa5e-feaa-4039-abc3-067024351ee1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.366132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'request_id': 'req-d967aa5e-feaa-4039-abc3-067024351ee1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.372747 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad0c3cc9eaf41c09d6b967a2fa49900', 'request_id': 'req-d967aa5e-feaa-4039-abc3-067024351ee1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.397297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] The token cache is being invalidate because project 6ad0c3cc9eaf41c09d6b967a2fa49900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:08.397779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.398546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.400498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1239/2460] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:08 2022] DELETE /identity/v3/projects/6ad0c3cc9eaf41c09d6b967a2fa49900 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:08.405263 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.405833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.406205 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.444068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:08.446075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:08.469857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.472344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:08.557909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1222/2461] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:08.558896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.560557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:08.572482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f410d8-c4d2-4d71-a7b7-4fb34c7274dd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.577747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.578617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.578904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.579186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] PATH_INFO: `/v3/users/902f574061e64236ae8d6df08093c8e2` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.580379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] RBAC: Authorizing `identity:delete_user(user_id=902f574061e64236ae8d6df08093c8e2)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.582914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.591644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967aa5e-feaa-4039-abc3-067024351ee1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.596933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.597624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.598504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.598504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.600213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:08.612833 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.615267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a960bf4-e3b7-4b0e-9f8e-0827d60d918e service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.626149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1240/2462] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:08.627438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.627724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.628001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.636352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902f574061e64236ae8d6df08093c8e2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.638100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902f574061e64236ae8d6df08093c8e2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.639105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902f574061e64236ae8d6df08093c8e2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.648557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:08.651483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:08.653211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:08.659225 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902f574061e64236ae8d6df08093c8e2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.663824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1241/2463] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:08.667976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.669738 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902f574061e64236ae8d6df08093c8e2'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:08.677932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5394c-25bb-44fb-abfc-0089b735e402 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.683225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.684371 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.684775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.685394 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.686189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:08.686500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.688231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.690117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1223/2464] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:08 2022] DELETE /identity/v3/users/902f574061e64236ae8d6df08093c8e2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:08.704735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1242/2465] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:08.714260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.779751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8d5f-c912-4976-b2f4-7cef62e8783a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.784595 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.786194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.786489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.786768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.787469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.789454 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.829720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1224/2466] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:08 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:08.831391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.846421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb608bc-9680-44d1-b220-e65efbc04263 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.881730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.883795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:08.913999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:08.954189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.955227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.955581 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.955937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.956719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.959322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.968850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6e09-443f-4a26-a1ea-ae9f6557c6f5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:08.974832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:08.976075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:08.976368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:08.976653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] PATH_INFO: `/v3/projects/7691c75f7a3448e38a99489d3df21925` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:08.977903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7691c75f7a3448e38a99489d3df21925)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:08.982845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:08.983006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1243/2467] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:08 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:08.985746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:08.998941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a1eb0-0df2-4297-b712-be4aa3c0d8ff admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.006044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.006849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.008186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.008186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.009109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.011110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.024755 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1244/2468] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:09.030093 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.042288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fefee-4e74-4172-8824-21d222463424 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.045090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7691c75f7a3448e38a99489d3df21925', 'request_id': 'req-e0f70820-056e-429c-bbf1-6d4bd9047a60'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:09.047040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:09.054382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7691c75f7a3448e38a99489d3df21925', 'request_id': 'req-e0f70820-056e-429c-bbf1-6d4bd9047a60'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:09.062965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7691c75f7a3448e38a99489d3df21925', 'request_id': 'req-e0f70820-056e-429c-bbf1-6d4bd9047a60'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:09.076626 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] The token cache is being invalidate because project 7691c75f7a3448e38a99489d3df21925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:09.077007 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:09.077822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e0f70820-056e-429c-bbf1-6d4bd9047a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:09.080080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1225/2469] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:08 2022] DELETE /identity/v3/projects/7691c75f7a3448e38a99489d3df21925 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:09.085530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb2f90-033d-42a5-bcf1-0e228531f8ef None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.085902 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb2f90-033d-42a5-bcf1-0e228531f8ef None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.086185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb2f90-033d-42a5-bcf1-0e228531f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.107072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f9bb2f90-033d-42a5-bcf1-0e228531f8ef None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:09.108769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f9bb2f90-033d-42a5-bcf1-0e228531f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.109526 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.110272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.110559 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.110839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.111570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.113240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.118113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1226/2470] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:09.126594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1245/2471] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:09.127371 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.127669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.127948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.130801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.132948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.149770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:09.150258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32558c-bf55-4d81-a941-57a79d8f940f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.150963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.157578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.159131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.163987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1227/2472] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:09.164238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.164238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] PATH_INFO: `/v3/projects/a7e2f6eefdc6439b953cd213e88cc637/users/7b1c47aa307e400c86e68680ce99e7ea/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.165163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.174681 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4159d6-c318-4349-ad70-dc579e822cdd None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.178590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e2f6eefdc6439b953cd213e88cc637, user_id=7b1c47aa307e400c86e68680ce99e7ea, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.179987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.180649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.180963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.181237 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.181766 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.181961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:09.182268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.183918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0184cc-9614-44b0-b874-87198e5c4fbf admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.197103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1246/2473] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:09 2022] PUT /identity/v3/projects/a7e2f6eefdc6439b953cd213e88cc637/users/7b1c47aa307e400c86e68680ce99e7ea/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:09.200984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1228/2474] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:09.202660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.207984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.208554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.209013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.240959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] MFA Rules not processed for user `7b1c47aa307e400c86e68680ce99e7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:09.242353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.275186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c86763-8e2f-4df5-992c-a35442abcc6c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.279990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.281507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.281507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.281507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.282151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.284083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.314928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1229/2475] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:09.319317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1247/2476] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:09.319585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.320465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.331287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1598a-75b3-4eee-b810-649dab95326a None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.342937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:09.397448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.402052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.402170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.402644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.403818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.405110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b28a2e-a87c-44c8-a91d-72b01839ce15 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.407374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.412120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.413323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.413635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.413918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.414645 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.416948 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.438079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1230/2477] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:09.442983 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1248/2478] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:09.443650 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.446973 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.457586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade217f-5180-4fda-bb9c-211bc61fa5e1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.481781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:09.525081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.525762 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.526051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.526331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.527059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.528703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.530095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c15ab-fa6e-48fc-b132-42f1760b6c37 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.535370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.536234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.536523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.536838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.537539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.539724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.548074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1249/2479] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:09.549499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.562104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c91a-b9d4-444b-97f7-c8079ae7cbdb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.568851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.569860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.570154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.570435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.571727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.572840 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1231/2480] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:09.573582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.574113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.587407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee1e3-4f27-4ce9-b843-c99dde8dda48 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.587711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1250/2481] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:09.591608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.595470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.596796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.597533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.598291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.599928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.605115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.610285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95a4a-6ed6-4ac5-bdab-7da33c792a1d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.618101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1232/2482] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:09.621694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360a632-69eb-41cd-a06c-974445dddace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.622196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.622809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360a632-69eb-41cd-a06c-974445dddace admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.623218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360a632-69eb-41cd-a06c-974445dddace admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.623562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360a632-69eb-41cd-a06c-974445dddace admin admin] PATH_INFO: `/v3/projects/ac560715c9ed42af930faf40fe5160ae/users/dd3acbfc053f4823ae12da18581e45cb/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.636617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade75e-bddb-43ac-b2fe-1635a9a7ea06 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.641135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360a632-69eb-41cd-a06c-974445dddace admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac560715c9ed42af930faf40fe5160ae, user_id=dd3acbfc053f4823ae12da18581e45cb, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.643880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.645165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360a632-69eb-41cd-a06c-974445dddace admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.646078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.646521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.646807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] PATH_INFO: `/v3/projects/24ae3ce1d74c4384b8db86daea675485/users/3581289332f84315b9e930b68c86a87a/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.661247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1251/2483] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:09 2022] PUT /identity/v3/projects/ac560715c9ed42af930faf40fe5160ae/users/dd3acbfc053f4823ae12da18581e45cb/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:09.668120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ae3ce1d74c4384b8db86daea675485, user_id=3581289332f84315b9e930b68c86a87a, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.672016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.672309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.672586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.684557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.704747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1233/2484] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:09 2022] PUT /identity/v3/projects/24ae3ce1d74c4384b8db86daea675485/users/3581289332f84315b9e930b68c86a87a/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:09.709631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.709821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] MFA Rules not processed for user `dd3acbfc053f4823ae12da18581e45cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:09.710860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.785660 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:09.796669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e188f6b-2285-4dd5-91c4-fdb09b1c48f5 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.800717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1252/2485] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:09.805285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.806448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.807014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.807381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.808217 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.809952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.811013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.812606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.822866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1234/2486] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:09.828106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:09.846320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4e9d2-9900-4cdb-a108-9713f3d3edee admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.852557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649781a-7696-41a2-b798-92d765499458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:09.853545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649781a-7696-41a2-b798-92d765499458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.853873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649781a-7696-41a2-b798-92d765499458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.854147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649781a-7696-41a2-b798-92d765499458 admin admin] PATH_INFO: `/v3/projects/24ae3ce1d74c4384b8db86daea675485/users/3581289332f84315b9e930b68c86a87a/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.856186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649781a-7696-41a2-b798-92d765499458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ae3ce1d74c4384b8db86daea675485, user_id=3581289332f84315b9e930b68c86a87a, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:09.858878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649781a-7696-41a2-b798-92d765499458 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:09.873771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1235/2487] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:09 2022] PUT /identity/v3/projects/24ae3ce1d74c4384b8db86daea675485/users/3581289332f84315b9e930b68c86a87a/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:09.887590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:09.888164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:09.888499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:09.923550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] MFA Rules not processed for user `3581289332f84315b9e930b68c86a87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:09.929111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:09.930536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829145-981c-4709-85e1-6deda5ee5d5f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:09.989601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:10.010844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:10.011515 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.011801 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.012081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.012515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1236/2488] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:10.025495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:10.027044 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:10.080158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:10.081806 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:10.090879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd52f6-f416-4892-bf7b-ff817d020615 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:10.092395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1253/2489] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:10.094892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:10.095549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.095865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.096141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.108538 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:10.110035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:10.120552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1237/2490] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:10.178364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:10.187943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9924e4-c217-4f7f-a90c-ae7ec249dcc8 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:10.198628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23747-d93b-4023-a826-234e255d4bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:10.204129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23747-d93b-4023-a826-234e255d4bdd service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.204129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23747-d93b-4023-a826-234e255d4bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.204129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23747-d93b-4023-a826-234e255d4bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.237023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:10.270937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23747-d93b-4023-a826-234e255d4bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:10.272511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23747-d93b-4023-a826-234e255d4bdd service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:10.282996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1254/2491] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:10.327300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:10.390915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd63c-3440-465e-9a22-7e2683fcc12c service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:10.396188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:10.397228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.397517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.397804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] PATH_INFO: `/v3/users/dd3acbfc053f4823ae12da18581e45cb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.399112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3acbfc053f4823ae12da18581e45cb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:10.401105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:10.448917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3acbfc053f4823ae12da18581e45cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:10.449582 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3acbfc053f4823ae12da18581e45cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:10.450380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3acbfc053f4823ae12da18581e45cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:10.463686 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3acbfc053f4823ae12da18581e45cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:10.470636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3acbfc053f4823ae12da18581e45cb'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:10.484446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1238/2492] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:10 2022] DELETE /identity/v3/users/dd3acbfc053f4823ae12da18581e45cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:10.489528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.489848 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.490198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.508275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:10.509564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:10.578964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1255/2493] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:10.589154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:10.590586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:10.604380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:10.653485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8150-f923-44e9-9965-6cafff3d2a46 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:10.657156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376eebf-a2a8-4c86-bc6c-9a6a973d8b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:10.657802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376eebf-a2a8-4c86-bc6c-9a6a973d8b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.658088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376eebf-a2a8-4c86-bc6c-9a6a973d8b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.658366 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376eebf-a2a8-4c86-bc6c-9a6a973d8b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.667849 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376eebf-a2a8-4c86-bc6c-9a6a973d8b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:10.669401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376eebf-a2a8-4c86-bc6c-9a6a973d8b09 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:10.679014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1239/2494] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:10.952874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:10.954430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:10.977346 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1cbaa-317d-47ec-b7f2-48ff71b47643 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:10.982400 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:10.983525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:10.983998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:10.984450 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] PATH_INFO: `/v3/projects/ac560715c9ed42af930faf40fe5160ae` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:10.985942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac560715c9ed42af930faf40fe5160ae)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:10.987931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.036933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac560715c9ed42af930faf40fe5160ae', 'request_id': 'req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:11.042752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac560715c9ed42af930faf40fe5160ae', 'request_id': 'req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:11.049128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac560715c9ed42af930faf40fe5160ae', 'request_id': 'req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:11.061951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] The token cache is being invalidate because project ac560715c9ed42af930faf40fe5160ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:11.062242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:11.062855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-defe1ac7-c4d1-4d02-a61a-3ff6b76a9f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:11.064593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1256/2495] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:10 2022] DELETE /identity/v3/projects/ac560715c9ed42af930faf40fe5160ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:11.069494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.069781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.070055 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.087561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:11.088830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:11.150041 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1240/2496] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:11.157756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.158043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.158345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.177549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:11.181500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:11.189883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1257/2497] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:11.194272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.203925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d3e9-5390-4fc8-8580-84601fd1da1d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.208839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.209500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.209779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.210059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.210790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:11.211095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.212790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.226069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1241/2498] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:11.230453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.240639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e29d2-08da-4f94-9e2a-2f34d3f0618d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.245552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.246212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.246496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.246773 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.247473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.249436 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.280079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1258/2499] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:11.281524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.292144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69a581-1bcc-4ee3-b5ad-7e795ab3febb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.354505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.355195 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.355482 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.355761 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.356452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.358443 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.379820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1242/2500] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:11.383950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.394302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4a85-f38c-46bd-85c9-96c038dab531 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.399861 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.400528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.400851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.401129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.401853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.403475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.415036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1259/2501] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:11.419113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.429510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122d61e-dab1-4a8c-aa8a-9ea1887fbe2a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.434115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f84ae-3a5a-4ce8-894b-06bbe9fd8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.434764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f84ae-3a5a-4ce8-894b-06bbe9fd8f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.435296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f84ae-3a5a-4ce8-894b-06bbe9fd8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.435572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f84ae-3a5a-4ce8-894b-06bbe9fd8f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.436288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f84ae-3a5a-4ce8-894b-06bbe9fd8f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.437985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f84ae-3a5a-4ce8-894b-06bbe9fd8f55 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.448376 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1243/2502] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:11.452585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.464151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29632d-82b0-41f1-8de6-95cec59189c4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.468851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.469739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.470023 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.470298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] PATH_INFO: `/v3/projects/a458475768534384b27313f36b87c1ad/users/fbf33d9034fd48c7ac14acb766424805/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.484032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:11.490217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a458475768534384b27313f36b87c1ad, user_id=fbf33d9034fd48c7ac14acb766424805, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.493682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.508146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1260/2503] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:11 2022] PUT /identity/v3/projects/a458475768534384b27313f36b87c1ad/users/fbf33d9034fd48c7ac14acb766424805/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:11.518447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.518733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.519011 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.553994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] MFA Rules not processed for user `fbf33d9034fd48c7ac14acb766424805`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:11.555281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:11.563684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:11.632921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1244/2504] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:11.633034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.713055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c84e-a0a2-4808-9221-db9cb15659db admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.720356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.721164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.721513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.721859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.722683 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.725047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.757251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1261/2505] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:11.761050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.775127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658df363-2c5b-451d-beab-c846ff1a8ca7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.841466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.842448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.843052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.843623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.844467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.846594 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.868963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1245/2506] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:11 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:11.874021 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.893509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbc1e8-c2ac-41ec-a985-01e3a4535adb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.901363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.902378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.902974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.903414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.904323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.906075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.918523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1262/2507] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:11.923005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:11.935875 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9baabc-283d-49a8-9b43-93c173d286dc admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:11.941862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:11.942841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:11.943120 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:11.943417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] PATH_INFO: `/v3/projects/4ef1c15f74d0494a8c5e97a275b47a6e/users/71152acb1b3d4c14971b15d48015fa1e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:11.963085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef1c15f74d0494a8c5e97a275b47a6e, user_id=71152acb1b3d4c14971b15d48015fa1e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:11.965873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:11.985290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1246/2508] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:11 2022] PUT /identity/v3/projects/4ef1c15f74d0494a8c5e97a275b47a6e/users/71152acb1b3d4c14971b15d48015fa1e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:11.989504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:12.000903 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701c196-22f0-4c95-94ab-5e3b7e54f685 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:12.086190 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83071ba-d446-4142-9d9d-23c70d81a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:12.086995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83071ba-d446-4142-9d9d-23c70d81a582 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:12.087407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83071ba-d446-4142-9d9d-23c70d81a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:12.087750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83071ba-d446-4142-9d9d-23c70d81a582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:12.088552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83071ba-d446-4142-9d9d-23c70d81a582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:12.091263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83071ba-d446-4142-9d9d-23c70d81a582 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:12.105676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1263/2509] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:12.109827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:12.121770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a68d-c645-41c8-9b78-c18bdd2c87e1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:12.127689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:12.130125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:12.130125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:12.130125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] PATH_INFO: `/v3/projects/4ef1c15f74d0494a8c5e97a275b47a6e/users/71152acb1b3d4c14971b15d48015fa1e/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:12.132172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef1c15f74d0494a8c5e97a275b47a6e, user_id=71152acb1b3d4c14971b15d48015fa1e, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:12.135016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:12.148712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1247/2510] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:12 2022] PUT /identity/v3/projects/4ef1c15f74d0494a8c5e97a275b47a6e/users/71152acb1b3d4c14971b15d48015fa1e/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:12.171781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:12.172166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:12.172539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:12.211915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] MFA Rules not processed for user `71152acb1b3d4c14971b15d48015fa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:12.213243 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:12.293367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:12.334033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1264/2511] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:12.350234 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:12.356118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:12.462072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2194a3-5826-4686-9dba-1152103da131 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:12.468233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:12.469275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:12.469656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:12.470142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:12.481894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:12.483543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:12.495243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1248/2512] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:12.571625 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:12.581288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a977a2e-6e59-4608-ba40-38884221b1c1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:12.585487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0355615-d8a8-4927-b48b-718c12787383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:12.586221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0355615-d8a8-4927-b48b-718c12787383 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:12.586582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0355615-d8a8-4927-b48b-718c12787383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:12.586924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0355615-d8a8-4927-b48b-718c12787383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:12.654132 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0355615-d8a8-4927-b48b-718c12787383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:12.655741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0355615-d8a8-4927-b48b-718c12787383 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:12.668721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1265/2513] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:13.673244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:13.674939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:13.682552 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:13.756737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad7b6c-d1bd-4b8b-bd67-54b73d7ace9f service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:13.761268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:13.762145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:13.762424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:13.762695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] PATH_INFO: `/v3/users/7b1c47aa307e400c86e68680ce99e7ea` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:13.763879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1c47aa307e400c86e68680ce99e7ea)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:13.765859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:13.818177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1c47aa307e400c86e68680ce99e7ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:13.818976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1c47aa307e400c86e68680ce99e7ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:13.819760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1c47aa307e400c86e68680ce99e7ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:13.837632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1c47aa307e400c86e68680ce99e7ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:13.844870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1c47aa307e400c86e68680ce99e7ea'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:13.861254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1249/2514] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:13 2022] DELETE /identity/v3/users/7b1c47aa307e400c86e68680ce99e7ea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:13.866555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:13.867037 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:13.867170 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:13.886663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:13.888058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:13.975010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1266/2515] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:13.984040 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:13.985493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:14.057049 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f89c3e-0897-4e6d-99fd-3c59950829c0 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:14.061404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:14.062058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:14.062339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:14.062612 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:14.074758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:14.076242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:14.087845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1250/2516] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:14.423714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:14.425384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:14.440239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fad014-544d-4c8b-9202-28a78f873b94 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:14.445623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:14.447869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:14.448328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:14.448716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] PATH_INFO: `/v3/projects/a7e2f6eefdc6439b953cd213e88cc637` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:14.450299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e2f6eefdc6439b953cd213e88cc637)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:14.452869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:14.502193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e2f6eefdc6439b953cd213e88cc637', 'request_id': 'req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.508051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e2f6eefdc6439b953cd213e88cc637', 'request_id': 'req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.514313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e2f6eefdc6439b953cd213e88cc637', 'request_id': 'req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.527080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] The token cache is being invalidate because project a7e2f6eefdc6439b953cd213e88cc637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:14.527369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.528008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.529595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1267/2517] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:14 2022] DELETE /identity/v3/projects/a7e2f6eefdc6439b953cd213e88cc637 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:14.533962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:14.545103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758633dd-49a9-4ee1-aefa-f0651b611925 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:14.571372 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:14.607413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:14.608282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:14.608567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:14.608879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] PATH_INFO: `/v3/users/3581289332f84315b9e930b68c86a87a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:14.610113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3581289332f84315b9e930b68c86a87a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:14.612070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:14.664959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3581289332f84315b9e930b68c86a87a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.665631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3581289332f84315b9e930b68c86a87a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.666315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3581289332f84315b9e930b68c86a87a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.681157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3581289332f84315b9e930b68c86a87a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.688568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d91f77ca-01eb-4687-a488-f5a8b4868c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3581289332f84315b9e930b68c86a87a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:14.701469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1251/2518] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:14 2022] DELETE /identity/v3/users/3581289332f84315b9e930b68c86a87a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:14.985251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:14.986836 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:15.005854 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340677-21f5-4ca3-bd4e-b4a82e62a6ed admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.010036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:15.085204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.086388 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.086853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.087332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] PATH_INFO: `/v3/projects/24ae3ce1d74c4384b8db86daea675485` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.089199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ae3ce1d74c4384b8db86daea675485)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.092141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.147745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ae3ce1d74c4384b8db86daea675485', 'request_id': 'req-f354c096-c88e-4924-aea0-dc4a39a082f9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:15.153497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ae3ce1d74c4384b8db86daea675485', 'request_id': 'req-f354c096-c88e-4924-aea0-dc4a39a082f9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:15.159723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ae3ce1d74c4384b8db86daea675485', 'request_id': 'req-f354c096-c88e-4924-aea0-dc4a39a082f9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:15.171740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] The token cache is being invalidate because project 24ae3ce1d74c4384b8db86daea675485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:15.172033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:15.172695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f354c096-c88e-4924-aea0-dc4a39a082f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:15.174284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1268/2519] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:14 2022] DELETE /identity/v3/projects/24ae3ce1d74c4384b8db86daea675485 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:15.179760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.180045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.180322 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.202505 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:15.203910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:15.268936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1252/2520] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:15.277782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.278085 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.278962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.298616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:15.300978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:15.309819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1269/2521] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:15.314542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.326383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218ccf0-7fee-4167-86b0-2ab289855c10 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.331469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.332276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.332599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.332945 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.333842 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:15.334197 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.336078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.350669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1253/2522] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:15.355437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.367078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe73e7-f6d3-4d88-a47f-929c8694a898 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.374438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.375469 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.375935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.376382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.377595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.381598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.411927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1270/2523] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:15.416327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.434198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9a71e-9f93-4c33-b8f2-db8a48dc4f79 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.478919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:15.518112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.518830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.519113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.519952 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.521127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.522831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.555714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1254/2524] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:15.557189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.569648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08377d-6b10-4455-be9a-1ecfe5aa8cbb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.575098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.575831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.576147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.576430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.577219 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.578817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.595368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1271/2525] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:15.599559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.614678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688abe1a-b7cf-4ddc-89dc-eea6ac0b91b3 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.620560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027ca38-2cc0-44b2-ae23-d0cd08b6e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.621264 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027ca38-2cc0-44b2-ae23-d0cd08b6e857 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.621549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027ca38-2cc0-44b2-ae23-d0cd08b6e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.621822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027ca38-2cc0-44b2-ae23-d0cd08b6e857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.622558 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027ca38-2cc0-44b2-ae23-d0cd08b6e857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.624723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027ca38-2cc0-44b2-ae23-d0cd08b6e857 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.638085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1255/2526] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:15.641134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.653150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baaded-9f26-495e-bf43-092304a61c2a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.666204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.667171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.667440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.667726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] PATH_INFO: `/v3/projects/3524ef1c38a34c649203eae9be5b1156/users/fdff33c1699b46dd86bde28070a27832/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.685977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3524ef1c38a34c649203eae9be5b1156, user_id=fdff33c1699b46dd86bde28070a27832, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.688731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.702519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1272/2527] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:15 2022] PUT /identity/v3/projects/3524ef1c38a34c649203eae9be5b1156/users/fdff33c1699b46dd86bde28070a27832/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:15.713560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.714111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.714111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.741099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] MFA Rules not processed for user `fdff33c1699b46dd86bde28070a27832`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:15.742507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:15.812585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1256/2528] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:15.818305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.857965 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:15.888543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c064e-c4e7-4cf6-9626-5963cb7d19e4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:15.893297 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:15.894006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:15.895074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:15.895657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:15.896367 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:15.898327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:15.924100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1273/2529] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:15.928951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:15.940227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dac1d-b762-4cab-b907-1a446a5f7dcb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.000374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.001166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.001521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.001864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.002621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.004893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.031828 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1257/2530] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:15 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:16.036408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.055868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eba83-305a-4bf2-9482-532ad268ab34 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.055868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.055868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.055868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.056352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.056352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.056352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.067282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1274/2531] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:16.071543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.084082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf31cbf-8a4d-4d44-a443-e822d45ef0a6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.088961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.089850 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.090130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.090403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] PATH_INFO: `/v3/projects/07a6f1b076224e77ac2911f44bb36806/users/453ed06814cb4fbd9bf916a255dc3c38/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.105942 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a6f1b076224e77ac2911f44bb36806, user_id=453ed06814cb4fbd9bf916a255dc3c38, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.108745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.121346 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1258/2532] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:16 2022] PUT /identity/v3/projects/07a6f1b076224e77ac2911f44bb36806/users/453ed06814cb4fbd9bf916a255dc3c38/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:16.125245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.135110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd70f49-6382-4da7-86d7-786902327f03 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.195304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfb5e-c0fc-4828-b9a4-6740ac236ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.195877 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfb5e-c0fc-4828-b9a4-6740ac236ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.196163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfb5e-c0fc-4828-b9a4-6740ac236ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.196440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfb5e-c0fc-4828-b9a4-6740ac236ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.197198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfb5e-c0fc-4828-b9a4-6740ac236ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.198799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfb5e-c0fc-4828-b9a4-6740ac236ae7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.209632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1275/2533] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:16.213839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.224182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319c88-e485-4cef-93cb-a183d57d65eb admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.228827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.229710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.229998 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.230274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] PATH_INFO: `/v3/projects/07a6f1b076224e77ac2911f44bb36806/users/453ed06814cb4fbd9bf916a255dc3c38/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.232247 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a6f1b076224e77ac2911f44bb36806, user_id=453ed06814cb4fbd9bf916a255dc3c38, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.234930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.237182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:16.247121 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1259/2534] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:16 2022] PUT /identity/v3/projects/07a6f1b076224e77ac2911f44bb36806/users/453ed06814cb4fbd9bf916a255dc3c38/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:16.258926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.259222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.259501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.285906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] MFA Rules not processed for user `453ed06814cb4fbd9bf916a255dc3c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:16.287105 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:16.354397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1276/2535] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:16.367671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.369404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:16.426304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b823-420e-4959-b73f-4990205ab113 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.429955 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.430592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.430874 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.431151 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.440369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.441969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.451266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1260/2536] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:16.768989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.770946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:16.779813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.790308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adde7d6-30c2-48b9-a530-83990101f006 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.794861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '453ed06814cb4fbd9bf916a255dc3c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a6f1b076224e77ac2911f44bb36806', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.795512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.795788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.796077 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.796824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:16.797134 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.798731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.811527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:16.811814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1261/2537] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:16.816301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.826239 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47405d9d-7902-4a34-87a2-56ebb323a83b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.831099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '453ed06814cb4fbd9bf916a255dc3c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a6f1b076224e77ac2911f44bb36806', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.832281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.832800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.833131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.833826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.835743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.840865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280f24-a1fe-40e5-9940-2fd42a49d08e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.844331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.844995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.845275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.845548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.847508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:16.865385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1262/2538] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:16 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:16.869409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:16.912161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.913654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.923535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1277/2539] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:16.934033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b22ee-2798-470b-8664-04add269a15b tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:16.939097 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '453ed06814cb4fbd9bf916a255dc3c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a6f1b076224e77ac2911f44bb36806', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:16.939767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:16.940056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:16.940338 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:16.941770 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:16.942586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:16.944209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:16.956229 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1263/2540] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:16.995624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:17.006694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a32d-9bc2-4feb-acff-ddc1e4ef2796 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:17.011397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '453ed06814cb4fbd9bf916a255dc3c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a6f1b076224e77ac2911f44bb36806', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:17.012261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:17.012696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:17.012984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] PATH_INFO: `/v3/projects/d5807fdbdfc04f61a3ba5af9535dbb78` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:17.014233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5807fdbdfc04f61a3ba5af9535dbb78)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:17.017349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:17.067456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5807fdbdfc04f61a3ba5af9535dbb78', 'request_id': 'req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.077345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5807fdbdfc04f61a3ba5af9535dbb78', 'request_id': 'req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.084003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5807fdbdfc04f61a3ba5af9535dbb78', 'request_id': 'req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.102921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] The token cache is being invalidate because project d5807fdbdfc04f61a3ba5af9535dbb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:17.103356 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.104158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9cf55c6c-6e31-4c2c-95f4-cd99e895934e tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.106260 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1278/2541] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:16 2022] DELETE /identity/v3/projects/d5807fdbdfc04f61a3ba5af9535dbb78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:17.308179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:17.310270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:17.373014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:17.377509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a00f-8b0c-4028-9291-9b76412bdb47 tempest-VolumeQuotaClassesTest-1964753688 tempest-VolumeQuotaClassesTest-1964753688-project-admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:17.436549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:17.437546 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:17.437836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:17.438117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] PATH_INFO: `/v3/users/fdff33c1699b46dd86bde28070a27832` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:17.439641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdff33c1699b46dd86bde28070a27832)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:17.441379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:17.490516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdff33c1699b46dd86bde28070a27832'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.491183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdff33c1699b46dd86bde28070a27832'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.491793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdff33c1699b46dd86bde28070a27832'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.504024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdff33c1699b46dd86bde28070a27832'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.514856 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdff33c1699b46dd86bde28070a27832'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:17.532713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1264/2542] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:17 2022] DELETE /identity/v3/users/fdff33c1699b46dd86bde28070a27832 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:17.534416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:17.534769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:17.535679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:17.555350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:17.556574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:17.621725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1279/2543] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:17.631663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:17.633178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:17.696557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf86e-aa1d-4617-9d78-f6efe888c33f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:17.700293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:17.700975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:17.701260 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:17.701536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:17.711449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:17.712924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:17.722714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1265/2544] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:18.011412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:18.012969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:18.020156 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:18.035289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a19d4a-cabb-4715-b634-c2cf076d90e6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:18.043978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:18.045088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:18.045373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:18.045648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] PATH_INFO: `/v3/projects/3524ef1c38a34c649203eae9be5b1156` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:18.046887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3524ef1c38a34c649203eae9be5b1156)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:18.048803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:18.102613 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3524ef1c38a34c649203eae9be5b1156', 'request_id': 'req-e8906383-1e5b-406a-946d-b3ca500e057c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.108524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3524ef1c38a34c649203eae9be5b1156', 'request_id': 'req-e8906383-1e5b-406a-946d-b3ca500e057c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.115159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3524ef1c38a34c649203eae9be5b1156', 'request_id': 'req-e8906383-1e5b-406a-946d-b3ca500e057c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.129293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] The token cache is being invalidate because project 3524ef1c38a34c649203eae9be5b1156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:18.129586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.130214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.132916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1280/2545] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:18 2022] DELETE /identity/v3/projects/3524ef1c38a34c649203eae9be5b1156 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:18.136165 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:18.149848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e9276-fb3f-4497-beaa-527c74333f02 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:18.174536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:18.220536 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:18.221463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:18.221744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:18.222017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] PATH_INFO: `/v3/users/453ed06814cb4fbd9bf916a255dc3c38` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:18.224029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453ed06814cb4fbd9bf916a255dc3c38)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:18.226033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:18.276769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453ed06814cb4fbd9bf916a255dc3c38'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.277381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453ed06814cb4fbd9bf916a255dc3c38'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.277995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453ed06814cb4fbd9bf916a255dc3c38'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.291377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453ed06814cb4fbd9bf916a255dc3c38'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.298426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-117c4a21-9865-46a4-b9cc-35326ab42f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453ed06814cb4fbd9bf916a255dc3c38'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.320863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1266/2546] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:18 2022] DELETE /identity/v3/users/453ed06814cb4fbd9bf916a255dc3c38 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:18.643130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:18.644890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:18.659503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906383-1e5b-406a-946d-b3ca500e057c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:18.754453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:18.755980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:18.756267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:18.757503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] PATH_INFO: `/v3/projects/07a6f1b076224e77ac2911f44bb36806` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:18.759374 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a6f1b076224e77ac2911f44bb36806)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:18.762632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:18.825264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a6f1b076224e77ac2911f44bb36806', 'request_id': 'req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.835977 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a6f1b076224e77ac2911f44bb36806', 'request_id': 'req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.845996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a6f1b076224e77ac2911f44bb36806', 'request_id': 'req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.882281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] The token cache is being invalidate because project 07a6f1b076224e77ac2911f44bb36806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:18.882573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.883405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce1464e-d1ae-4aed-a6f9-2bbe7b805c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:18.885552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1281/2547] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:18 2022] DELETE /identity/v3/projects/07a6f1b076224e77ac2911f44bb36806 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:18.890741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:18.891035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:18.891321 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:18.912324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:18.915221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:18.998747 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1267/2548] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:19.006601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.006890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.007171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.027499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:19.028774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:19.037976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1282/2549] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:19.043157 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.055530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5e6b1-2670-4cd3-b877-60a934c6c784 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.061621 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.062586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.063005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.063408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.064223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:19.064632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.066492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.084590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1268/2550] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:19.085812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.095502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3627e-1ba2-4dea-a512-03eaece49692 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.101414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.102092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.102378 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.102659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.103352 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.105348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.110286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:19.139921 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1283/2551] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:19 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:19.143936 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.155016 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861c3b6-9eda-4b0f-afec-2e3c1cc3d4d1 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.188813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:19.242196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.243073 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.243416 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.243696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.244587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.246703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.279006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1269/2552] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:19 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:19.282713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.297293 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6fdc-8366-4dd9-9c48-44dc21d25d0b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.301802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.302476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.302759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.303035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.303765 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.305569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.318922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1284/2553] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:19.322886 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.334232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688812-283d-4580-a95e-ab6556856ac2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.339128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4cfc-dc4a-4939-8123-66d70d023230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.339794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4cfc-dc4a-4939-8123-66d70d023230 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.340088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4cfc-dc4a-4939-8123-66d70d023230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.340369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4cfc-dc4a-4939-8123-66d70d023230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.341135 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4cfc-dc4a-4939-8123-66d70d023230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.342756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4cfc-dc4a-4939-8123-66d70d023230 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.354694 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1270/2554] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:19.358725 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.371034 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6587b2-8ba6-4192-95d1-340781447572 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.376844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.379151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.379600 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.380035 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] PATH_INFO: `/v3/projects/bd2a96265dac43f7aa5d5dd62d28db79/users/8806e87810eb498cbd496e0dbf2059c9/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.405537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2a96265dac43f7aa5d5dd62d28db79, user_id=8806e87810eb498cbd496e0dbf2059c9, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.411148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.427866 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1285/2555] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:19 2022] PUT /identity/v3/projects/bd2a96265dac43f7aa5d5dd62d28db79/users/8806e87810eb498cbd496e0dbf2059c9/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:19.438580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.438921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.439201 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.469523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] MFA Rules not processed for user `8806e87810eb498cbd496e0dbf2059c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:19.470950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:19.552813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1271/2556] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:19.564339 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:19.567898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:19.646100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e729fe-5fee-4f66-a50f-d6a5e347ea59 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:19.651169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:19.651828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:19.652153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:19.652380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:19.664334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:19.667089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:19.693879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1286/2557] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:20.392568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:20.394938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:20.461648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c5557-1d5f-4140-bff1-7d659a34a839 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:20.466188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:20.467061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:20.467345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:20.467620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] PATH_INFO: `/v3/users/41618b0540e64de4b968d5cdc39bea0a` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:20.468836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41618b0540e64de4b968d5cdc39bea0a)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:20.470800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:20.510941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:20.516919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41618b0540e64de4b968d5cdc39bea0a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.517951 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41618b0540e64de4b968d5cdc39bea0a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.518699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41618b0540e64de4b968d5cdc39bea0a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.535724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41618b0540e64de4b968d5cdc39bea0a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.539106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-c2482ad7-cd3e-48b4-9bb1-a8be29704871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41618b0540e64de4b968d5cdc39bea0a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.552449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1272/2558] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:20 2022] DELETE /identity/v3/users/41618b0540e64de4b968d5cdc39bea0a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:20.731300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:20.744057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c1211-606f-466d-a364-6b28c9ad7513 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:20.803283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:20.804202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:20.804481 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:20.804790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] PATH_INFO: `/v3/projects/197671139e6b42069ba82ea9fdf1da40` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:20.806295 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197671139e6b42069ba82ea9fdf1da40)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:20.808198 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:20.858885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197671139e6b42069ba82ea9fdf1da40', 'request_id': 'req-9d563145-0ae4-403a-998e-b8cbc3897512'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.865992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:20.867507 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197671139e6b42069ba82ea9fdf1da40', 'request_id': 'req-9d563145-0ae4-403a-998e-b8cbc3897512'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.880397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197671139e6b42069ba82ea9fdf1da40', 'request_id': 'req-9d563145-0ae4-403a-998e-b8cbc3897512'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.896237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] The token cache is being invalidate because project 197671139e6b42069ba82ea9fdf1da40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:20.896780 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.897514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9d563145-0ae4-403a-998e-b8cbc3897512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:20.899108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1287/2559] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:20 2022] DELETE /identity/v3/projects/197671139e6b42069ba82ea9fdf1da40 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:20.904200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:20.904343 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:20.904646 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:20.939387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:20.940636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:21.011442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1273/2560] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:21.019292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.019611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.019969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.044069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:21.045329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:21.054574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1288/2561] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:21.061129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.071156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8611c-23f6-4310-a2be-62cf4db92191 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.075749 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.076412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.076720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.077006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.077755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:21.078074 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.079710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.093909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1274/2562] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:21.098763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.108362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c204671-31bf-4709-a1fd-55722c236ba1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.113325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.113986 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.114269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.114574 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.115302 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.117275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.146735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1289/2563] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:21 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:21.148133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.161878 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13432c82-6dd5-4037-bf2d-6bcd31af5ddd admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.225655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.226446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.226758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.227034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.227759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.229768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.258025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1275/2564] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:21 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:21.262148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.273547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151d7e5-31de-4427-b52d-4e890ee4fade admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.278285 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.278953 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.279240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.279549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.280292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.281939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.293110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1290/2565] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:21.297125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.307243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb9ef7-9a7b-436b-8e1e-5855973efa67 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.312146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1079f8-73cc-45a3-ad63-575901832928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.312832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1079f8-73cc-45a3-ad63-575901832928 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.313119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1079f8-73cc-45a3-ad63-575901832928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.313395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1079f8-73cc-45a3-ad63-575901832928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.314114 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1079f8-73cc-45a3-ad63-575901832928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.315715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1079f8-73cc-45a3-ad63-575901832928 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.325777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1276/2566] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:21.329842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.340566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6b26d-61cf-4857-a643-23023c85d60c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.345182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.346059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.346344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.346626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] PATH_INFO: `/v3/projects/84778f1b00884338bcd011f70ff14664/users/768379d599c94cf8aca4d8cfb1a3852c/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.362068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84778f1b00884338bcd011f70ff14664, user_id=768379d599c94cf8aca4d8cfb1a3852c, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.364941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.377614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1291/2567] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:21 2022] PUT /identity/v3/projects/84778f1b00884338bcd011f70ff14664/users/768379d599c94cf8aca4d8cfb1a3852c/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:21.388471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.388801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.389090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.416463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] MFA Rules not processed for user `768379d599c94cf8aca4d8cfb1a3852c`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:21.417644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:21.429532 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:21.484198 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1277/2568] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:21.496045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:21.497819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:21.573159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494cb7-04d2-41e7-b124-97a7dc223f56 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:21.578832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21ce8-449b-4af5-a0c5-04a5d00497fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:21.579474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21ce8-449b-4af5-a0c5-04a5d00497fc service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:21.579756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21ce8-449b-4af5-a0c5-04a5d00497fc service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:21.580060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21ce8-449b-4af5-a0c5-04a5d00497fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:21.589788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b21ce8-449b-4af5-a0c5-04a5d00497fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:21.591369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b21ce8-449b-4af5-a0c5-04a5d00497fc service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:21.600231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1292/2569] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:22.199685 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:22.201111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:22.265308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c69cb-f8a7-483e-a58a-31222c5037ef None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:22.270786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:22.271635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:22.272703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:22.272703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] PATH_INFO: `/v3/users/fbf33d9034fd48c7ac14acb766424805` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:22.273491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf33d9034fd48c7ac14acb766424805)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:22.275427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:22.322897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf33d9034fd48c7ac14acb766424805'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.323554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf33d9034fd48c7ac14acb766424805'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.324175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf33d9034fd48c7ac14acb766424805'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.336685 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf33d9034fd48c7ac14acb766424805'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.343563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf33d9034fd48c7ac14acb766424805'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.355918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1278/2570] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:22 2022] DELETE /identity/v3/users/fbf33d9034fd48c7ac14acb766424805 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:22.360740 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:22.361229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:22.361591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:22.378905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:22.380180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:22.438379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1293/2571] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:22.448894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:22.450294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:22.488378 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:22.511515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72ab2f-407a-4184-b285-1a126be88796 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:22.515193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:22.515860 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:22.516164 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:22.516436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:22.525931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:22.527362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:22.536537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1279/2572] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:22.799334 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:22.801305 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:22.813832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f544-fa32-42ee-a195-20c93fed7ca5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:22.819420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:22.820284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:22.820564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:22.820894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] PATH_INFO: `/v3/projects/a458475768534384b27313f36b87c1ad` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:22.822069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a458475768534384b27313f36b87c1ad)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:22.823975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:22.825967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:22.874873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a458475768534384b27313f36b87c1ad', 'request_id': 'req-6b5b5e67-712b-4753-ad63-9279b09e9c5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.881078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a458475768534384b27313f36b87c1ad', 'request_id': 'req-6b5b5e67-712b-4753-ad63-9279b09e9c5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.887268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a458475768534384b27313f36b87c1ad', 'request_id': 'req-6b5b5e67-712b-4753-ad63-9279b09e9c5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.899230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] The token cache is being invalidate because project a458475768534384b27313f36b87c1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:22.899509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.900137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:22.901724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1294/2573] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:22 2022] DELETE /identity/v3/projects/a458475768534384b27313f36b87c1ad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:22.905701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:22.916161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b687fa-8654-4ca6-8281-3aa4823c84e8 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:22.971800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:22.973419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:22.973697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:22.973971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] PATH_INFO: `/v3/users/71152acb1b3d4c14971b15d48015fa1e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:22.975292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71152acb1b3d4c14971b15d48015fa1e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:22.977250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:23.026130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71152acb1b3d4c14971b15d48015fa1e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.026782 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71152acb1b3d4c14971b15d48015fa1e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.027381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71152acb1b3d4c14971b15d48015fa1e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.039869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71152acb1b3d4c14971b15d48015fa1e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.046831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-58216bfb-dfd8-479f-844f-1a594967a9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71152acb1b3d4c14971b15d48015fa1e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.060611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1280/2574] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:22 2022] DELETE /identity/v3/users/71152acb1b3d4c14971b15d48015fa1e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:23.577804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:23.579271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:23.593831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b5e67-712b-4753-ad63-9279b09e9c5f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:23.657597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:23.658499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:23.658784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:23.659059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] PATH_INFO: `/v3/projects/4ef1c15f74d0494a8c5e97a275b47a6e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:23.661148 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef1c15f74d0494a8c5e97a275b47a6e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:23.663097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:23.709925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef1c15f74d0494a8c5e97a275b47a6e', 'request_id': 'req-926e3e55-5511-4dfe-a456-808e82f13ade'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.715286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef1c15f74d0494a8c5e97a275b47a6e', 'request_id': 'req-926e3e55-5511-4dfe-a456-808e82f13ade'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.721573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef1c15f74d0494a8c5e97a275b47a6e', 'request_id': 'req-926e3e55-5511-4dfe-a456-808e82f13ade'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.733958 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] The token cache is being invalidate because project 4ef1c15f74d0494a8c5e97a275b47a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:23.734268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.734878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-926e3e55-5511-4dfe-a456-808e82f13ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:23.736395 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1295/2575] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:23 2022] DELETE /identity/v3/projects/4ef1c15f74d0494a8c5e97a275b47a6e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:23.741410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:23.741884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:23.742019 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:23.760548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:23.761784 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:23.809702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:23.823511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1281/2576] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:23.832712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:23.833011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:23.833314 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:23.851974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:23.853199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:23.861011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1296/2577] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:23.865586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:23.875514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb0bf-0143-421c-b58f-53636c88dd6d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:23.881088 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:23.881823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:23.882107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:23.882384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:23.883113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:23.883442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:23.885188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:23.898071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1282/2578] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:23.902341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:23.912629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb8d0-e084-42c1-8316-ab8b7d1b409c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:23.917255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:23.917898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:23.918175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:23.918442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:23.919127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:23.921045 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:23.931218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:23.949907 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1297/2579] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:23 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:23.954301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:23.966591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc62253-45e9-43ae-a004-822f4c708ebe admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.025477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.026153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.026465 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.026742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.027436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.029428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.053571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1283/2580] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:23 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:24.054952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.069040 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9379b9-ae2a-4b51-8137-302b1bfa326c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.074713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.075655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.076207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.076396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.077216 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.078790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.090027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1298/2581] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:24.094103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.105452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0525-7318-44cc-8af4-17a2cae4e713 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.110305 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ecd95-3b99-437a-b888-d1549e238cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.110963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecd95-3b99-437a-b888-d1549e238cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.111245 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecd95-3b99-437a-b888-d1549e238cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.111524 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecd95-3b99-437a-b888-d1549e238cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.112241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ecd95-3b99-437a-b888-d1549e238cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.114388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ecd95-3b99-437a-b888-d1549e238cd1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.124351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1284/2582] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:24.129386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.139088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38830d-8fa2-4019-8335-7f69e9e399b9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.143647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.145230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.145508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.145790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] PATH_INFO: `/v3/projects/1d5c3714948642f7a5db8a59ec21976c/users/a07ae6122f6e4de69c1bbd6439217b19/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.161323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5c3714948642f7a5db8a59ec21976c, user_id=a07ae6122f6e4de69c1bbd6439217b19, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.163979 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.175887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1299/2583] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:24 2022] PUT /identity/v3/projects/1d5c3714948642f7a5db8a59ec21976c/users/a07ae6122f6e4de69c1bbd6439217b19/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:24.187336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.187633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.187919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.215115 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] MFA Rules not processed for user `a07ae6122f6e4de69c1bbd6439217b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:24.216337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:24.279994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1285/2584] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:24.284431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.349548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a905-fbd9-4b36-94d0-e0c4e249e0bb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.354208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.354884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.355146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.355429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.356127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.358069 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.387299 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1300/2585] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:24 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:24.388970 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.405300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74532dc2-4125-41c8-b62d-b4b220ed87cb None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.452462 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:24.464387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.465203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.465492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.465764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.466455 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.468627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.493731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1286/2586] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:24 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:24.497532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.508317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d6bc-a12d-4443-8b6d-a54860f43faa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.514501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.514501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.514501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.514501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.515078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.516663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.528637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1301/2587] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:24.532665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.543892 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cef59-6119-41cd-9471-b860e1f46818 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.549514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.550317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.550706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.550867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] PATH_INFO: `/v3/projects/eb4dd8c80ab34840a105b6306a024464/users/aa84e858798342ed83ea302d9bafa583/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.567981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4dd8c80ab34840a105b6306a024464, user_id=aa84e858798342ed83ea302d9bafa583, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.570819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.584636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1287/2588] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:24 2022] PUT /identity/v3/projects/eb4dd8c80ab34840a105b6306a024464/users/aa84e858798342ed83ea302d9bafa583/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:24.588552 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.599738 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255952c-8a18-40fe-8262-e7e0725722b7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.659835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9b25-305e-4e64-b69b-43daac17070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.660799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9b25-305e-4e64-b69b-43daac17070f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.661095 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9b25-305e-4e64-b69b-43daac17070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.661383 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9b25-305e-4e64-b69b-43daac17070f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.662141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9b25-305e-4e64-b69b-43daac17070f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.663739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9b25-305e-4e64-b69b-43daac17070f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.677140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1302/2589] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:24.678721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.691559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602c32-06e8-4e3b-90c4-efe7ea29aee9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.700774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.701680 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.701964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.702240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] PATH_INFO: `/v3/projects/eb4dd8c80ab34840a105b6306a024464/users/aa84e858798342ed83ea302d9bafa583/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.704361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4dd8c80ab34840a105b6306a024464, user_id=aa84e858798342ed83ea302d9bafa583, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.707789 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.718962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1288/2590] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:24 2022] PUT /identity/v3/projects/eb4dd8c80ab34840a105b6306a024464/users/aa84e858798342ed83ea302d9bafa583/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:24.729844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.730121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.730405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.758709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] MFA Rules not processed for user `aa84e858798342ed83ea302d9bafa583`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:24.759956 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:24.773528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:24.839817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1303/2591] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:24.853359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:24.855133 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:24.918960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7f8fc-6398-4c41-93dd-0054e372b5c9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:24.922604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:24.923244 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:24.923521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:24.923794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:24.933000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:24.935154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:24.948623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1289/2592] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:25.031313 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:25.041562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2723ff-818a-431b-9d95-1a50c6a5b0b4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:25.045248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee0fed-3f17-4ec9-8eb9-0bbf3a358f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:25.045884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee0fed-3f17-4ec9-8eb9-0bbf3a358f5e service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:25.046169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee0fed-3f17-4ec9-8eb9-0bbf3a358f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:25.046448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee0fed-3f17-4ec9-8eb9-0bbf3a358f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:25.106891 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee0fed-3f17-4ec9-8eb9-0bbf3a358f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:25.108411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee0fed-3f17-4ec9-8eb9-0bbf3a358f5e service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:25.119041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1304/2593] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:26.428587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:26.428587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:26.498580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2869fc-80f2-4d51-a89a-ba272ff9c1dd service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:26.504379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:26.504752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:26.505042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:26.505319 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] PATH_INFO: `/v3/users/768379d599c94cf8aca4d8cfb1a3852c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:26.506507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768379d599c94cf8aca4d8cfb1a3852c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:26.508530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:26.561655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768379d599c94cf8aca4d8cfb1a3852c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:26.562570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768379d599c94cf8aca4d8cfb1a3852c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:26.563547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768379d599c94cf8aca4d8cfb1a3852c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:26.564922 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:26.580993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768379d599c94cf8aca4d8cfb1a3852c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:26.587866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768379d599c94cf8aca4d8cfb1a3852c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:26.603188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1290/2594] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:26 2022] DELETE /identity/v3/users/768379d599c94cf8aca4d8cfb1a3852c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:26.607664 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:26.608150 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:26.608340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:26.627256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:26.629689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:26.706119 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1305/2595] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:26.720063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:26.721551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:26.782489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c43498-3468-4786-a49b-e4e3e21a8764 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:26.787447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:26.788106 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:26.788388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:26.788664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:26.797925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:26.799379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:26.810085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1291/2596] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:27.088644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.090166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.113673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03396453-89f7-4bae-8ead-40a970d4a8fc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.118558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.119364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.119482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.119731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.120007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] PATH_INFO: `/v3/projects/84778f1b00884338bcd011f70ff14664` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.120935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.121792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84778f1b00884338bcd011f70ff14664)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.123867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.134962 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669ce2-3a4e-462e-8458-da3b05664e8a service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.139569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.140434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.140742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.141020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] PATH_INFO: `/v3/users/8806e87810eb498cbd496e0dbf2059c9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.142216 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8806e87810eb498cbd496e0dbf2059c9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.144949 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.176328 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:27.179793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84778f1b00884338bcd011f70ff14664', 'request_id': 'req-0760ead4-3600-4cd7-bbc2-bbdff7338053'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.186870 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84778f1b00884338bcd011f70ff14664', 'request_id': 'req-0760ead4-3600-4cd7-bbc2-bbdff7338053'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.193655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8806e87810eb498cbd496e0dbf2059c9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.193963 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84778f1b00884338bcd011f70ff14664', 'request_id': 'req-0760ead4-3600-4cd7-bbc2-bbdff7338053'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.194362 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8806e87810eb498cbd496e0dbf2059c9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.195265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8806e87810eb498cbd496e0dbf2059c9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.207514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] The token cache is being invalidate because project 84778f1b00884338bcd011f70ff14664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:27.207805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.208441 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0760ead4-3600-4cd7-bbc2-bbdff7338053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.209555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8806e87810eb498cbd496e0dbf2059c9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.210097 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1306/2597] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:27 2022] DELETE /identity/v3/projects/84778f1b00884338bcd011f70ff14664 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:27.214758 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a053-ca9a-4800-8fce-c5e8a1403cb8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.215041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a053-ca9a-4800-8fce-c5e8a1403cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.215317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a053-ca9a-4800-8fce-c5e8a1403cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.217212 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cf7ee344-696a-46ea-a2df-e5c85ea2559b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8806e87810eb498cbd496e0dbf2059c9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.231399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1292/2598] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:27 2022] DELETE /identity/v3/users/8806e87810eb498cbd496e0dbf2059c9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:27.235478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8d19a053-ca9a-4800-8fce-c5e8a1403cb8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:27.235728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.236015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.236288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.236789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8d19a053-ca9a-4800-8fce-c5e8a1403cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.255051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:27.256297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.290280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:27.299595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1307/2599] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:27.308056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.308353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.308636 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.325192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1293/2600] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:27.328096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:27.329381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.331703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.332987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.337351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1308/2601] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:27.341350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.350377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e9d6-ba60-49d0-a19a-388c9847585a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.355180 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.355906 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.356212 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.356491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.357245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:27.357555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.359155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.374919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1309/2602] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:27.375874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.386473 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc6314-1619-473b-85bd-b8f8cfebe2b2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.391120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.391756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.392039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.392348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.393081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.393733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f5e56-91c9-47d5-aa08-878b6bcf7205 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.395497 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.397580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.398224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.398503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.398774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.407963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.409966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.419960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1294/2603] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:27.423366 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1310/2604] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:27.427985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.437959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf626c0-116c-4970-8fd6-271946535926 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.498385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.499087 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.499492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.499767 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.500492 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.502488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.526312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1295/2605] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:27.527561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.539012 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59520bf-8cbd-4d41-b3a2-81a426bf6767 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.544890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.545680 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.545993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.546273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.547195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.549124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.564206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1311/2606] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:27.565775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.577199 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cfffc-67e3-4797-a3b1-5f181eb7ac96 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.582063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69218f5-be07-46f6-9a56-a0a20eea33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.582729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69218f5-be07-46f6-9a56-a0a20eea33ad admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.583014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69218f5-be07-46f6-9a56-a0a20eea33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.583320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69218f5-be07-46f6-9a56-a0a20eea33ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.584048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69218f5-be07-46f6-9a56-a0a20eea33ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.585704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69218f5-be07-46f6-9a56-a0a20eea33ad admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.596355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1296/2607] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:27.601094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.611211 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7377638-e808-4256-95a7-898dd420bb36 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.617153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.618114 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.618462 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.618800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] PATH_INFO: `/v3/projects/6d4ead26a1cc489f9b110ded65854f97/users/59304614d5da4324b5e37fc5e4d394c4/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.634049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4ead26a1cc489f9b110ded65854f97, user_id=59304614d5da4324b5e37fc5e4d394c4, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.636669 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.650970 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1312/2608] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:27 2022] PUT /identity/v3/projects/6d4ead26a1cc489f9b110ded65854f97/users/59304614d5da4324b5e37fc5e4d394c4/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:27.662022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.662425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.662737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.693005 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] MFA Rules not processed for user `59304614d5da4324b5e37fc5e4d394c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:27.694368 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.713056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.714943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.753622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:27.785243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1297/2609] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:27.789818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.805253 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:27.809671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f82c-e2f9-4c62-8502-07e8fa9cb367 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.817026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.817873 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.818482 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.819547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] PATH_INFO: `/v3/projects/bd2a96265dac43f7aa5d5dd62d28db79` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.821173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2a96265dac43f7aa5d5dd62d28db79)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.823588 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.863112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f77d5-9c54-47a2-924a-3f3f2fb33480 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.868535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.869240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.869528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.869802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.870491 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.872418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:27.884923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2a96265dac43f7aa5d5dd62d28db79', 'request_id': 'req-5b4433ef-fc16-464d-abf0-77f01cde66bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.891399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2a96265dac43f7aa5d5dd62d28db79', 'request_id': 'req-5b4433ef-fc16-464d-abf0-77f01cde66bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.898635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2a96265dac43f7aa5d5dd62d28db79', 'request_id': 'req-5b4433ef-fc16-464d-abf0-77f01cde66bd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.903719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1298/2610] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:27.906063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:27.917934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] The token cache is being invalidate because project bd2a96265dac43f7aa5d5dd62d28db79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:27.918447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.919643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5b4433ef-fc16-464d-abf0-77f01cde66bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:27.921884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1313/2611] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:27 2022] DELETE /identity/v3/projects/bd2a96265dac43f7aa5d5dd62d28db79 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:27.926468 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.926898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.927137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.951810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:27.953124 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:27.985659 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034e8c7-c79f-4c9b-a110-bfc9263415c7 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:27.991894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8160f-8194-454e-afb9-fb44cce1ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:27.992993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8160f-8194-454e-afb9-fb44cce1ea8b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:27.993286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8160f-8194-454e-afb9-fb44cce1ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:27.993567 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8160f-8194-454e-afb9-fb44cce1ea8b admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:27.994548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8160f-8194-454e-afb9-fb44cce1ea8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:27.997425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8160f-8194-454e-afb9-fb44cce1ea8b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.023509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1299/2612] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:28.025989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1314/2613] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:28.027399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.028832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.038213 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.038690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.039108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.041571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868898c-5749-42e8-853a-049e07c7ef25 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.046390 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.047126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.047483 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.047768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.048730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.051238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.060171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:28.061448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.062634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1315/2614] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:28.067447 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.077999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1300/2615] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:28.078353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c5fd1-6a5f-4e98-a693-2621fa0b19bf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.082373 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.083440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.084336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.084626 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.084936 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] PATH_INFO: `/v3/projects/5e93ba3e416f4bf39ebf2da58f1c2eea/users/617c13efc2664fcfb0c542f804bfda4f/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.094215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5feb3-597f-4c0b-bf84-55ab005a00f0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.104161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.104873 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.105156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.105433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.106156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:28.106473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.106824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e93ba3e416f4bf39ebf2da58f1c2eea, user_id=617c13efc2664fcfb0c542f804bfda4f, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.108103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.110424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.125758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1301/2616] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:16:28.126790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.126886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1316/2617] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:28 2022] PUT /identity/v3/projects/5e93ba3e416f4bf39ebf2da58f1c2eea/users/617c13efc2664fcfb0c542f804bfda4f/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:28.131196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.138896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852bf6d-0481-4c22-8b80-55b3e8f90c4c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.197793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:28.202975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:28.219390 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141966a-4717-4bdc-aa17-544892c24654 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.220442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.221299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.221651 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.222559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.223336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.225519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.225684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.226176 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.226465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.226739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.227492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.230265 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.242075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1317/2618] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:28.246428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.258667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1302/2619] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:28 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:28.261731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdc759-cc5e-43a0-95f9-a400055f9c65 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.262698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.325418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ca64-a840-4cc7-a5f4-66a38738f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.326320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ca64-a840-4cc7-a5f4-66a38738f88c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.326594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ca64-a840-4cc7-a5f4-66a38738f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.326876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ca64-a840-4cc7-a5f4-66a38738f88c admin admin] PATH_INFO: `/v3/projects/5e93ba3e416f4bf39ebf2da58f1c2eea/users/617c13efc2664fcfb0c542f804bfda4f/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.328942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ca64-a840-4cc7-a5f4-66a38738f88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e93ba3e416f4bf39ebf2da58f1c2eea, user_id=617c13efc2664fcfb0c542f804bfda4f, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.331639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ca64-a840-4cc7-a5f4-66a38738f88c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.343000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1318/2620] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:28 2022] PUT /identity/v3/projects/5e93ba3e416f4bf39ebf2da58f1c2eea/users/617c13efc2664fcfb0c542f804bfda4f/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:28.349446 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0dae-d13f-45d6-a715-48a3604cb45b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.356477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.356995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.357276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.389050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] MFA Rules not processed for user `617c13efc2664fcfb0c542f804bfda4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:28.390357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.419311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.420364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.420701 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.420979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.421661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.423620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.448737 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1303/2621] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:28 2022] POST /identity/v3/users => generated 281 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:28.450283 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.459838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ab9a-01ec-47b6-9c43-fdbb37c9417d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.464544 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.465228 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.465514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.465857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.467253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.468863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.478922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1319/2622] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:28.483746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1304/2623] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:28.484892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.494131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.496241 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.497146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552a1d-0bec-4851-a2ef-3c666e8443d2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.501839 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.502617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.504452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.504452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.504863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.506471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.517286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1320/2624] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:28.522274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.532561 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651f604-a7e8-4e43-ab03-92c80f0caf62 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.539242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5f3e-3166-4264-9dbc-478ede02f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.540501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5f3e-3166-4264-9dbc-478ede02f770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.541092 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5f3e-3166-4264-9dbc-478ede02f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.541453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5f3e-3166-4264-9dbc-478ede02f770 admin admin] PATH_INFO: `/v3/projects/55d3e564146d4bfcb7fe2ac6fe4ca75d/users/836a3f0305cd4e27982ba9cf9b037f13/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.559279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5f3e-3166-4264-9dbc-478ede02f770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d3e564146d4bfcb7fe2ac6fe4ca75d, user_id=836a3f0305cd4e27982ba9cf9b037f13, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.563276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5f3e-3166-4264-9dbc-478ede02f770 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.568933 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d7b17-0281-46cc-ae57-acf228359076 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.573561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.574329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.574613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.574921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.577023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.579667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1321/2625] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:28 2022] PUT /identity/v3/projects/55d3e564146d4bfcb7fe2ac6fe4ca75d/users/836a3f0305cd4e27982ba9cf9b037f13/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:28.589481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:28.591144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.591632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.592096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.623899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] MFA Rules not processed for user `836a3f0305cd4e27982ba9cf9b037f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:28.625304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.644726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.646356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.648309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:28.659543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1305/2626] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:28.708646 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1322/2627] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:28.794658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.796112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:28.809687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca586cf-eb5b-4a7e-a4ab-0bcf9c1b47e8 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:28.875908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d20754-4a65-4645-b4ce-8528cb72db17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:28.876619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d20754-4a65-4645-b4ce-8528cb72db17 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:28.876937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d20754-4a65-4645-b4ce-8528cb72db17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:28.877253 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d20754-4a65-4645-b4ce-8528cb72db17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:28.887192 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d20754-4a65-4645-b4ce-8528cb72db17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:28.888695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d20754-4a65-4645-b4ce-8528cb72db17 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:28.899775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1306/2628] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:28.915055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:28.997250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85844bdd-91cc-4600-8a1f-afe4e12640c6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.006098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.006988 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.007271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.007548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] PATH_INFO: `/v3/users/836a3f0305cd4e27982ba9cf9b037f13` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.008980 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=836a3f0305cd4e27982ba9cf9b037f13)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.010917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.059101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836a3f0305cd4e27982ba9cf9b037f13'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.066225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836a3f0305cd4e27982ba9cf9b037f13'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.066994 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836a3f0305cd4e27982ba9cf9b037f13'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.078768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836a3f0305cd4e27982ba9cf9b037f13'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.086173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836a3f0305cd4e27982ba9cf9b037f13'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.092011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1323/2629] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:28 2022] DELETE /identity/v3/users/836a3f0305cd4e27982ba9cf9b037f13 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:29.096548 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.096903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.097186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.113826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:29.115026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:29.179993 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1307/2630] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:29.189840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.191793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:29.238825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:29.252644 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4f7d-4d6e-4ef2-b5f2-ec1604bf5a0e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.256924 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834484-b718-4588-931a-159691ad10a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.257597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834484-b718-4588-931a-159691ad10a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.257882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834484-b718-4588-931a-159691ad10a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.258161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834484-b718-4588-931a-159691ad10a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.267193 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834484-b718-4588-931a-159691ad10a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.269493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834484-b718-4588-931a-159691ad10a3 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.279066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1324/2631] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:29.553489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.555056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:29.568219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c13f-c601-4357-9c0e-9f63b2cefb88 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.573233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.574105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.574424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.574838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] PATH_INFO: `/v3/projects/55d3e564146d4bfcb7fe2ac6fe4ca75d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.576032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d3e564146d4bfcb7fe2ac6fe4ca75d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.578017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.624734 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d3e564146d4bfcb7fe2ac6fe4ca75d', 'request_id': 'req-21104762-15d8-4c73-a76d-6a717808f0da'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.626281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:29.632345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d3e564146d4bfcb7fe2ac6fe4ca75d', 'request_id': 'req-21104762-15d8-4c73-a76d-6a717808f0da'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.639181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d3e564146d4bfcb7fe2ac6fe4ca75d', 'request_id': 'req-21104762-15d8-4c73-a76d-6a717808f0da'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.650272 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] The token cache is being invalidate because project 55d3e564146d4bfcb7fe2ac6fe4ca75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:29.650593 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.651258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-21104762-15d8-4c73-a76d-6a717808f0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:29.652800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1308/2632] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:29 2022] DELETE /identity/v3/projects/55d3e564146d4bfcb7fe2ac6fe4ca75d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:29.657643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.658110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.658213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.676499 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:29.677830 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:29.742991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1325/2633] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:29.751387 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.751675 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.751956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.771727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:29.772958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:29.780775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1309/2634] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:29.785562 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.795444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2626c-a23f-43b7-950d-11f2998acdb6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.801721 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.802380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.802663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.802938 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.803659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:29.803989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.805855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.819115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1326/2635] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:29.822890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.832083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557760c-cc6a-4e12-a860-f5948451e603 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.837052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.837790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.838070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.838344 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.839176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.841125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.871428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1310/2636] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:29 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:29.872401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.882580 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38cb4-6a06-4831-bec2-b7289f85b5ce admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.944014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.944719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.945011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.945292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.945992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.947928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.959654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.961622 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:29.968151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1327/2637] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:29 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:29.972813 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:29.975422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c397-9b4f-4458-81c2-a4603bfcc59b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.980082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.981010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.981292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.981575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] PATH_INFO: `/v3/users/a07ae6122f6e4de69c1bbd6439217b19` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.982549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff521a6-1b12-496a-b34c-a4654e29b42f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:29.982790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07ae6122f6e4de69c1bbd6439217b19)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.984756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:29.987118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:29.988536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:29.988993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:29.989271 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:29.989984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:29.991565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.001677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1328/2638] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:30.005748 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.019741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd427-ffd0-4756-926f-7ceae4de9e4f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.024885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.025629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.025985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.026335 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.027369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.029131 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.040128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07ae6122f6e4de69c1bbd6439217b19'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.040894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07ae6122f6e4de69c1bbd6439217b19'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.041310 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1329/2639] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:30.045390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07ae6122f6e4de69c1bbd6439217b19'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.045843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.047974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.060057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07ae6122f6e4de69c1bbd6439217b19'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.067320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-3c0b913d-25f1-4bd2-9f91-d833cd9c46b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07ae6122f6e4de69c1bbd6439217b19'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.068555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5e23-80de-4abd-a646-0818e36c25bc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.076998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bebec-e25b-449c-b875-b2e518a5ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.077968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bebec-e25b-449c-b875-b2e518a5ce95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.078258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bebec-e25b-449c-b875-b2e518a5ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.078539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bebec-e25b-449c-b875-b2e518a5ce95 admin admin] PATH_INFO: `/v3/projects/07bf84b8699340c48a4ffc89734b67ac/users/309456dd17454ac596a58643ca356a9b/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.082430 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1311/2640] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:29 2022] DELETE /identity/v3/users/a07ae6122f6e4de69c1bbd6439217b19 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:30.087459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.087807 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.088177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.101904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bebec-e25b-449c-b875-b2e518a5ce95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bf84b8699340c48a4ffc89734b67ac, user_id=309456dd17454ac596a58643ca356a9b, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.105942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bebec-e25b-449c-b875-b2e518a5ce95 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.112188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:30.113846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.122610 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1330/2641] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:30 2022] PUT /identity/v3/projects/07bf84b8699340c48a4ffc89734b67ac/users/309456dd17454ac596a58643ca356a9b/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:30.134685 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.135013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.135752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.168089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] MFA Rules not processed for user `309456dd17454ac596a58643ca356a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:30.169695 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.174338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:30.193573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1312/2642] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:30.205039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.208000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.252286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:INSERT=3,keystone:DELETE=13,keystone:SELECT=84 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:30.261732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1331/2643] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:30.269161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.281051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310bf7-6c95-4a2c-9471-a6ac389820c2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.289308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.289308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.289308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.289308 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.290234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.292194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.299101 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcb239-8f83-4046-ae13-9200196ecde1 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.303716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.304458 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.304836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.305185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.316648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.318868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.329135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1332/2644] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:30.331194 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1313/2645] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:30.333451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.400654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d903533-abca-41bd-8631-507028e48c49 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.405724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.406465 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.406746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.407143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.407932 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.410606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.431233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1333/2646] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:30.435437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.446054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74d6e8-a0c0-4e3c-93f9-28f0140081df service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.450764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.451428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.451704 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.451976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.452714 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.454302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.464712 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1314/2647] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:30.468582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.479954 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6d60-b216-438b-bfd5-79abc7703d5c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.489161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2852ed-4d90-47d4-bec1-0c7d09e337fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.489943 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2852ed-4d90-47d4-bec1-0c7d09e337fb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.490301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2852ed-4d90-47d4-bec1-0c7d09e337fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.491247 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2852ed-4d90-47d4-bec1-0c7d09e337fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.491571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2852ed-4d90-47d4-bec1-0c7d09e337fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.493635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2852ed-4d90-47d4-bec1-0c7d09e337fb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.505234 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1334/2648] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:30.509361 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.519787 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df202f-587c-41e8-b86e-54cd0b54d413 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.524811 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.525764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.526111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.526453 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] PATH_INFO: `/v3/projects/cb849f001d0045dab4369f25e82ec96e/users/64d18e77a3054998bee124a2845dc740/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.542559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb849f001d0045dab4369f25e82ec96e, user_id=64d18e77a3054998bee124a2845dc740, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.546095 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.562834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1315/2649] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:30 2022] PUT /identity/v3/projects/cb849f001d0045dab4369f25e82ec96e/users/64d18e77a3054998bee124a2845dc740/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:30.573223 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.573635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.573903 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.603724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] MFA Rules not processed for user `64d18e77a3054998bee124a2845dc740`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:30.605087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.622137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.623937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.666539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:30.687892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1335/2650] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:30.692419 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.710186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975f33-0fde-4628-af1c-dd314dc1a152 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.714927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.715791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.716075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.716352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] PATH_INFO: `/v3/projects/1d5c3714948642f7a5db8a59ec21976c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.717590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5c3714948642f7a5db8a59ec21976c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.719521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.756408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40130ad-9ebd-4cef-a8af-092aba2714e1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.769243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5c3714948642f7a5db8a59ec21976c', 'request_id': 'req-d4f096f2-485d-4823-b786-c98e4c63b72a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.778509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5c3714948642f7a5db8a59ec21976c', 'request_id': 'req-d4f096f2-485d-4823-b786-c98e4c63b72a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.786669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5c3714948642f7a5db8a59ec21976c', 'request_id': 'req-d4f096f2-485d-4823-b786-c98e4c63b72a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.797452 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] The token cache is being invalidate because project 1d5c3714948642f7a5db8a59ec21976c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:30.797742 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.798434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.800575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1316/2651] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:30 2022] DELETE /identity/v3/projects/1d5c3714948642f7a5db8a59ec21976c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:30.804702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.806131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.816016 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.816699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.817009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.817288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.817981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.819884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.828915 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:30.847330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1336/2652] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:30.851240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.852976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:30.879502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f096f2-485d-4823-b786-c98e4c63b72a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.917927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5e9a5-bba7-4260-90af-9764f9a9e486 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.923161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.923829 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.924118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.924401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.925301 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.927266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.936484 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.937384 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.937752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.938057 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] PATH_INFO: `/v3/users/aa84e858798342ed83ea302d9bafa583` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.939356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa84e858798342ed83ea302d9bafa583)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.941591 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.947750 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1337/2653] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:30 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:30.951565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.962246 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1c33b-342f-418c-ba06-b37f2fa51fd2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:30.967274 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:30.967946 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:30.968214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:30.968560 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:30.969510 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:30.971116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:30.982214 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1338/2654] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:30.986242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:30.991127 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:30.993023 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa84e858798342ed83ea302d9bafa583'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.993711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa84e858798342ed83ea302d9bafa583'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.994351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa84e858798342ed83ea302d9bafa583'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:30.997618 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b910-fc21-4b06-bb82-d697329a222f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.002694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.003880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.004162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.004431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] PATH_INFO: `/v3/projects/4ea57666ae304a6eb65d0698123f025d/users/60a432608dc5455a85382bb8a24e9004/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.006788 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa84e858798342ed83ea302d9bafa583'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.013940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa84e858798342ed83ea302d9bafa583'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.021237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea57666ae304a6eb65d0698123f025d, user_id=60a432608dc5455a85382bb8a24e9004, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.023989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.027924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1317/2655] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:30 2022] DELETE /identity/v3/users/aa84e858798342ed83ea302d9bafa583 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:31.039828 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1339/2656] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:30 2022] PUT /identity/v3/projects/4ea57666ae304a6eb65d0698123f025d/users/60a432608dc5455a85382bb8a24e9004/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:31.043684 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.045147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.096290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:31.115792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c9c62-457d-4a6b-8640-4b16f709c608 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.180959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927caba-5304-4fb2-8033-1da77b9b116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.181644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927caba-5304-4fb2-8033-1da77b9b116e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.182156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927caba-5304-4fb2-8033-1da77b9b116e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.182342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927caba-5304-4fb2-8033-1da77b9b116e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.183235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927caba-5304-4fb2-8033-1da77b9b116e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.184695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927caba-5304-4fb2-8033-1da77b9b116e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.198510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1318/2657] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:31.200392 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.211784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cdbb7-19a5-4ddf-876d-d02e353c19a3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.216781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.217671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.217951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.218222 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] PATH_INFO: `/v3/projects/4ea57666ae304a6eb65d0698123f025d/users/60a432608dc5455a85382bb8a24e9004/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.220172 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea57666ae304a6eb65d0698123f025d, user_id=60a432608dc5455a85382bb8a24e9004, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.222966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.233585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1340/2658] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:31 2022] PUT /identity/v3/projects/4ea57666ae304a6eb65d0698123f025d/users/60a432608dc5455a85382bb8a24e9004/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:31.245108 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065777b-f57f-4f22-b76f-77518011630f None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.245895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065777b-f57f-4f22-b76f-77518011630f None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.246188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065777b-f57f-4f22-b76f-77518011630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.275679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1065777b-f57f-4f22-b76f-77518011630f None None] MFA Rules not processed for user `60a432608dc5455a85382bb8a24e9004`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:31.277008 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1065777b-f57f-4f22-b76f-77518011630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.312642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.314504 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.361302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1319/2659] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:31.373084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065777b-f57f-4f22-b76f-77518011630f None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.374449 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1065777b-f57f-4f22-b76f-77518011630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.386480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae280a9-46f1-43b8-ad55-afa030bf73b1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.391616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.392551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.392934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.393286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] PATH_INFO: `/v3/projects/eb4dd8c80ab34840a105b6306a024464` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.395224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4dd8c80ab34840a105b6306a024464)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.397182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.433918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065777b-f57f-4f22-b76f-77518011630f None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.445989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4dd8c80ab34840a105b6306a024464', 'request_id': 'req-999c4084-ecde-4761-9124-0e18cdce0711'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.452411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4dd8c80ab34840a105b6306a024464', 'request_id': 'req-999c4084-ecde-4761-9124-0e18cdce0711'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.459546 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4dd8c80ab34840a105b6306a024464', 'request_id': 'req-999c4084-ecde-4761-9124-0e18cdce0711'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.464078 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:31.472502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] The token cache is being invalidate because project eb4dd8c80ab34840a105b6306a024464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:31.472876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.473513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-999c4084-ecde-4761-9124-0e18cdce0711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:31.475121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1341/2660] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:31 2022] DELETE /identity/v3/projects/eb4dd8c80ab34840a105b6306a024464 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:31.479689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182f81-2fc1-466a-bcf8-4ad98f31559d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.479976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182f81-2fc1-466a-bcf8-4ad98f31559d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.480254 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182f81-2fc1-466a-bcf8-4ad98f31559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.486590 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.487292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.487572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.487845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.489652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.498811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2c182f81-2fc1-466a-bcf8-4ad98f31559d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:31.500074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2c182f81-2fc1-466a-bcf8-4ad98f31559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.549391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:31.553514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.555480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.563090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1342/2661] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:16:31.565360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1320/2662] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:31.572624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.572951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.573315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.592702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:31.593975 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:31.603353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1343/2663] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:31.607645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.619254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305dae8-b2cf-4f5a-bd9e-adecc9dbcf3a service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.624648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.625327 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.625607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.625883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.626598 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:31.626899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.628573 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.640349 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1321/2664] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:31.645385 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.654566 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05a7cc-52de-4522-b747-d74969228e1f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.659718 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.660782 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.661066 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.661341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.662032 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.664079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.692783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1344/2665] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:31 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:31.696498 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.707490 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5cbe-5474-4787-bccd-18173471bf3b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.769927 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.770606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.770893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.771166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.771893 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.773920 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.795185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1322/2666] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:31 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:31.799417 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.811151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5362-4fa7-46a5-a789-69429fce269c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.816245 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.816945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.817232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.817509 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.818238 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.819885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.834997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1345/2667] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:31.836171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.846728 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cec25-befd-42db-aacd-fe48a67aca70 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.852010 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0542683-d594-4907-9e7b-57750f34a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.852776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0542683-d594-4907-9e7b-57750f34a458 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.853062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0542683-d594-4907-9e7b-57750f34a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.853293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0542683-d594-4907-9e7b-57750f34a458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.854031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0542683-d594-4907-9e7b-57750f34a458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.855638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0542683-d594-4907-9e7b-57750f34a458 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.867434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1323/2668] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:16:31.871601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:31.884244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe381-a198-4723-83b2-f11a42ba7d35 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:31.890887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:31.892200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.892937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.895289 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] PATH_INFO: `/v3/projects/98f4fc46451e4743b1cbb6ffe07455c8/users/9332ec651d2d41068255916e83d70e14/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.911812 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f4fc46451e4743b1cbb6ffe07455c8, user_id=9332ec651d2d41068255916e83d70e14, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:31.914887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:31.928602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1346/2669] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:31 2022] PUT /identity/v3/projects/98f4fc46451e4743b1cbb6ffe07455c8/users/9332ec651d2d41068255916e83d70e14/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:31.939989 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:31.940282 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:31.941145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:31.967461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] MFA Rules not processed for user `9332ec651d2d41068255916e83d70e14`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:31.968594 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.009609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:32.035166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1324/2670] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:32.046666 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:32.048438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.105409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f9ec-be0e-48ba-b4fc-b12f4330fe4a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:32.109088 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf31e68-0209-47cc-82a3-a98411df25b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:32.109724 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31e68-0209-47cc-82a3-a98411df25b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.110008 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31e68-0209-47cc-82a3-a98411df25b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.110284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31e68-0209-47cc-82a3-a98411df25b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.118843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf31e68-0209-47cc-82a3-a98411df25b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:32.120266 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf31e68-0209-47cc-82a3-a98411df25b7 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:32.129742 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1347/2671] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:32.149020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:32.210313 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7752213-e144-48f8-8da9-4cd103437dc0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:32.214924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:32.215797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.216079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.216357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] PATH_INFO: `/v3/users/9332ec651d2d41068255916e83d70e14` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.217654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9332ec651d2d41068255916e83d70e14)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:32.219576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:32.273601 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9332ec651d2d41068255916e83d70e14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.274254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9332ec651d2d41068255916e83d70e14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.274925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9332ec651d2d41068255916e83d70e14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.286500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9332ec651d2d41068255916e83d70e14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.293177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9332ec651d2d41068255916e83d70e14'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.305940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1325/2672] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:32 2022] DELETE /identity/v3/users/9332ec651d2d41068255916e83d70e14 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:32.310665 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.310955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.311232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.329010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:32.330522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.390149 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1348/2673] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:32.399905 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:32.401369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.457845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33d84f-901f-4378-9ef6-b31430c7a245 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:32.461488 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d06e-e2b3-42a9-a188-ab3f0018b7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:32.462131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d06e-e2b3-42a9-a188-ab3f0018b7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.462409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d06e-e2b3-42a9-a188-ab3f0018b7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.462682 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d06e-e2b3-42a9-a188-ab3f0018b7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.471610 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d06e-e2b3-42a9-a188-ab3f0018b7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:32.473029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d06e-e2b3-42a9-a188-ab3f0018b7a0 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:32.482422 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1326/2674] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:32.759981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:32.761500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.774104 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f04b4-444c-4a65-8cdf-617049eaeeec None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:32.779215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:32.780078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.780359 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.780629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] PATH_INFO: `/v3/projects/98f4fc46451e4743b1cbb6ffe07455c8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.781864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f4fc46451e4743b1cbb6ffe07455c8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:32.783809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:32.821162 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:32.835763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f4fc46451e4743b1cbb6ffe07455c8', 'request_id': 'req-24b7faef-7814-45ae-a65c-c013df0a757f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.841568 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f4fc46451e4743b1cbb6ffe07455c8', 'request_id': 'req-24b7faef-7814-45ae-a65c-c013df0a757f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.849050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f4fc46451e4743b1cbb6ffe07455c8', 'request_id': 'req-24b7faef-7814-45ae-a65c-c013df0a757f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.861896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] The token cache is being invalidate because project 98f4fc46451e4743b1cbb6ffe07455c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:32.862908 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.863831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-24b7faef-7814-45ae-a65c-c013df0a757f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:32.865578 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1349/2675] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:32 2022] DELETE /identity/v3/projects/98f4fc46451e4743b1cbb6ffe07455c8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:32.871479 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.871968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.871968 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.878605 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:32.891939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:32.893188 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.960275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1327/2676] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:32.967918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:32.968213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:32.968496 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:32.987915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:32.989116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:32.997046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1350/2677] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:33.001235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.011291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b481f-75e1-40a5-b8bb-c9e079b2359e None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.015906 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.016556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.016880 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.017160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.017888 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:33.018200 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.019928 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.031995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1328/2678] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:33.036753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.045978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd95035-1522-45ad-bd2a-ff110399f10b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.051524 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.052179 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.052467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.052781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.053517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.059154 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.083073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1351/2679] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:33 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:33.087181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.098285 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d14ce-0400-4a9c-8885-2d9ed5df078e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.153760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.154424 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.154711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.154988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.155746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.157735 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.180708 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1329/2680] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:33 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:33.185108 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.196641 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dfacb-e396-4530-b277-f82b83f80abb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.202067 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.202730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.203010 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.203281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.204001 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.205624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.217730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1352/2681] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:33.222048 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.232068 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe7a7-824e-4f0f-8292-af3ee1e57f6a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.238499 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1617f3-595f-46ff-9b6b-37ef3a1eccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.239299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1617f3-595f-46ff-9b6b-37ef3a1eccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.239603 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1617f3-595f-46ff-9b6b-37ef3a1eccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.239882 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1617f3-595f-46ff-9b6b-37ef3a1eccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.240611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1617f3-595f-46ff-9b6b-37ef3a1eccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.242326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1617f3-595f-46ff-9b6b-37ef3a1eccc9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.254844 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1330/2682] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:33.259923 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.270233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfd2cd-8311-40fd-89ad-963c2d03ecbf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.275004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.275890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.276171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.276460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] PATH_INFO: `/v3/projects/6f29eecfa9984eb8aac53a21e25dc56f/users/06fc6c6f43ad4c83baa0654b5f54e6d9/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.293399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f29eecfa9984eb8aac53a21e25dc56f, user_id=06fc6c6f43ad4c83baa0654b5f54e6d9, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.296175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.311270 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1353/2683] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:33 2022] PUT /identity/v3/projects/6f29eecfa9984eb8aac53a21e25dc56f/users/06fc6c6f43ad4c83baa0654b5f54e6d9/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:33.323092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.323385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.323696 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.353056 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] MFA Rules not processed for user `06fc6c6f43ad4c83baa0654b5f54e6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:33.354304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:33.372259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.374712 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:33.423514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:33.433901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1331/2684] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:33.444824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:33.446233 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:33.449598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691af70-7c69-4c93-8933-b3db73172ff9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.453862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.454513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.454800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.455082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.457919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:33.504863 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a05e8b-3f42-4ace-bbbf-2e867bfc4903 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:33.510431 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:33.511096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:33.511385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:33.511665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:33.521879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.523293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.532914 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1332/2685] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:33.534992 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:33.536706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:33.547951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1354/2686] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:16:34.201769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:34.203496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:34.221146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2083-82f5-4f11-9460-c3793ccf04fc service glance] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:34.226658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:34.227577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:34.227697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:34.227912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:34.229913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:34.317903 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:34.319517 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:34.328917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1333/2687] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:36.797125 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:36.798678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:36.807527 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:36.893819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccb13-db84-452e-a71f-85000e0049a0 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:36.900935 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:36.901596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:36.901893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:36.902229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:36.904151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:36.973995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:36.975673 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:36.986930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1355/2688] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:37.123113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:37.133758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f6b77-36f8-4686-8bca-9675bfdd4033 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:37.139641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:37.140973 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:37.141428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:37.141889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:37.144521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:37.220958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:37.222688 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:37.232776 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1334/2689] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:42.927393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:42.928950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:42.991169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d0d1c-e9f0-4bcb-a69e-d812e5853b45 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:42.995059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:42.995703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:42.996056 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:42.996331 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:42.998341 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:43.052620 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:43.065165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:43.066607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e9169-1472-438d-9665-6e9ff8536cfe service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:43.076026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1356/2690] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:43.342910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:43.344356 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:43.358182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9378b8-e47a-470a-b559-457aa8a7c2cb service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:43.363004 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:43.363943 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:43.364897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:43.365175 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] PATH_INFO: `/v3/users/309456dd17454ac596a58643ca356a9b` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:43.366586 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=309456dd17454ac596a58643ca356a9b)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:43.368534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:43.400050 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:43.421898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309456dd17454ac596a58643ca356a9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:43.422748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309456dd17454ac596a58643ca356a9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:43.423571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309456dd17454ac596a58643ca356a9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:43.439642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309456dd17454ac596a58643ca356a9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:43.446957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309456dd17454ac596a58643ca356a9b'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:43.460406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1335/2691] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:43 2022] DELETE /identity/v3/users/309456dd17454ac596a58643ca356a9b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:43.465103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:43.465399 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:43.465675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:43.483431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:43.484629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:43.551919 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1357/2692] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:43.561259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:43.562672 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:43.625994 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5ac5d-544f-4af6-8b41-d9c6250eaf79 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:43.631557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:43.632242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:43.632520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:43.632855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:43.643432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:43.644934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:43.656388 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1336/2693] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:44.101495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:44.103101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:44.122171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01d59-daee-4e27-b3eb-f8000f70f517 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:44.127596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:44.128602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:44.128920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:44.129202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] PATH_INFO: `/v3/projects/07bf84b8699340c48a4ffc89734b67ac` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:44.131165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bf84b8699340c48a4ffc89734b67ac)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:44.133259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:44.234608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bf84b8699340c48a4ffc89734b67ac', 'request_id': 'req-6c896c94-6954-45e5-9923-275dded30fb5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.257429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bf84b8699340c48a4ffc89734b67ac', 'request_id': 'req-6c896c94-6954-45e5-9923-275dded30fb5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.273534 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bf84b8699340c48a4ffc89734b67ac', 'request_id': 'req-6c896c94-6954-45e5-9923-275dded30fb5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.293094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] The token cache is being invalidate because project 07bf84b8699340c48a4ffc89734b67ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:44.293409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.296898 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.299136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1358/2694] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:44 2022] DELETE /identity/v3/projects/07bf84b8699340c48a4ffc89734b67ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:44.303302 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:44.314350 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b914e1-c4f0-4576-9b29-4964860e0bbc service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:44.376883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:44.377806 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:44.378091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:44.378365 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] PATH_INFO: `/v3/users/64d18e77a3054998bee124a2845dc740` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:44.379638 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d18e77a3054998bee124a2845dc740)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:44.381670 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:44.435039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d18e77a3054998bee124a2845dc740'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.435764 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d18e77a3054998bee124a2845dc740'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.436520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d18e77a3054998bee124a2845dc740'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.438561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:44.451846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d18e77a3054998bee124a2845dc740'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.460303 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d18e77a3054998bee124a2845dc740'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:44.475027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1337/2695] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:44 2022] DELETE /identity/v3/users/64d18e77a3054998bee124a2845dc740 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:44.808116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:44.809997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:44.837990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896c94-6954-45e5-9923-275dded30fb5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:44.951607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:44.952511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:44.952819 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:44.953517 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] PATH_INFO: `/v3/projects/cb849f001d0045dab4369f25e82ec96e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:44.954377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb849f001d0045dab4369f25e82ec96e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:44.956348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:44.976991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:45.018424 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb849f001d0045dab4369f25e82ec96e', 'request_id': 'req-f69a527d-78db-4e6a-b321-9733900e588d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.026824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb849f001d0045dab4369f25e82ec96e', 'request_id': 'req-f69a527d-78db-4e6a-b321-9733900e588d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.033409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb849f001d0045dab4369f25e82ec96e', 'request_id': 'req-f69a527d-78db-4e6a-b321-9733900e588d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.049351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] The token cache is being invalidate because project cb849f001d0045dab4369f25e82ec96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:45.049739 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.050446 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.053168 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1359/2696] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:44 2022] DELETE /identity/v3/projects/cb849f001d0045dab4369f25e82ec96e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:45.057086 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:45.058963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:45.073835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d55447-edb7-4ffa-a690-a1ce3fc27109 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:45.156655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:45.157577 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:45.157901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:45.158193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] PATH_INFO: `/v3/users/60a432608dc5455a85382bb8a24e9004` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:45.159345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a432608dc5455a85382bb8a24e9004)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:45.162081 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:45.225793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a432608dc5455a85382bb8a24e9004'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.226471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a432608dc5455a85382bb8a24e9004'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.227089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a432608dc5455a85382bb8a24e9004'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.241783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a432608dc5455a85382bb8a24e9004'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.252039 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-7ec58509-b946-405d-bc11-f60acfaf1356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a432608dc5455a85382bb8a24e9004'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.274697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1338/2697] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:45 2022] DELETE /identity/v3/users/60a432608dc5455a85382bb8a24e9004 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:45.601474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:45.604511 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:45.619191 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a527d-78db-4e6a-b321-9733900e588d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:45.704192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:45.705623 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:45.706208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:45.707025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] PATH_INFO: `/v3/projects/4ea57666ae304a6eb65d0698123f025d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:45.709033 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea57666ae304a6eb65d0698123f025d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:45.711060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:45.796121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea57666ae304a6eb65d0698123f025d', 'request_id': 'req-912f2218-88b8-4f51-bcee-3883dce4382a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.802505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea57666ae304a6eb65d0698123f025d', 'request_id': 'req-912f2218-88b8-4f51-bcee-3883dce4382a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.809370 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea57666ae304a6eb65d0698123f025d', 'request_id': 'req-912f2218-88b8-4f51-bcee-3883dce4382a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.829196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] The token cache is being invalidate because project 4ea57666ae304a6eb65d0698123f025d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:45.829538 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.830928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-912f2218-88b8-4f51-bcee-3883dce4382a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:45.836171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1360/2698] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:45 2022] DELETE /identity/v3/projects/4ea57666ae304a6eb65d0698123f025d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:45.837966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:45.838427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:45.838566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:45.859089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:45.860409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:45.920020 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:45.943803 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1339/2699] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:45.951495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:45.951789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:45.952068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:45.978342 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:45.979598 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:45.987967 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1361/2700] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:45.993235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.003613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f4ce-065a-430a-a1c7-88ccac410ea8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.009475 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.010163 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.010447 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.010726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.011470 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:46.011781 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.013487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.029660 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1340/2701] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:46.031429 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.050275 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfdb70-90b0-474a-8469-55bd1eec7f21 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.061072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.062347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.062862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.067642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.068831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.071410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.108821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1362/2702] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:46 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:46.112937 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.124768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1722-3294-48af-a018-df6634cea889 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.216743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.218180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.218648 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.219099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.220333 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.223931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.254912 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1341/2703] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:46 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:46.256401 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.272218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8629d-a862-4427-a8bb-fb0744bb2896 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.288976 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.290281 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.290570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.291318 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.292100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.294387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.295609 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:46.315656 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1363/2704] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:46.316128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.338508 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0093-6960-483a-9a6a-39dd6168c41c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.356525 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73bf69-b68d-403c-af99-c6b6c3ed8ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.357314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73bf69-b68d-403c-af99-c6b6c3ed8ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.357669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73bf69-b68d-403c-af99-c6b6c3ed8ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.358021 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73bf69-b68d-403c-af99-c6b6c3ed8ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.358889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73bf69-b68d-403c-af99-c6b6c3ed8ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.360609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73bf69-b68d-403c-af99-c6b6c3ed8ab4 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.403898 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1342/2705] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:46.405797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.425845 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d1d5b-2531-4d08-bd83-d150780b85aa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.436648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.437586 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.437863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.438138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] PATH_INFO: `/v3/projects/cb64651a79ca496dbf2a79dba7e085ff/users/1ec72d8adbb84b32a74b3c85a260c6a2/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.455549 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb64651a79ca496dbf2a79dba7e085ff, user_id=1ec72d8adbb84b32a74b3c85a260c6a2, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.459136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.474640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1364/2706] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:46 2022] PUT /identity/v3/projects/cb64651a79ca496dbf2a79dba7e085ff/users/1ec72d8adbb84b32a74b3c85a260c6a2/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:46.485170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e1f1-8810-4cb2-ba05-14a066db83f9 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.485969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e1f1-8810-4cb2-ba05-14a066db83f9 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.486357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e1f1-8810-4cb2-ba05-14a066db83f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.520967 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-39b5e1f1-8810-4cb2-ba05-14a066db83f9 None None] MFA Rules not processed for user `1ec72d8adbb84b32a74b3c85a260c6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:46.522203 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-39b5e1f1-8810-4cb2-ba05-14a066db83f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:46.601104 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1343/2707] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:46.612607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:46.614900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:46.686543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfcb9e-4a35-48f2-9224-2089e9f0efc4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:46.691548 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:46.692920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:46.693210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:46.693490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:46.702843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:46.704292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:46.713585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1365/2708] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:48.147979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:48.148483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:48.148584 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:48.167740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] MFA Rules not processed for user `1ec72d8adbb84b32a74b3c85a260c6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:48.168996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:48.177801 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1344/2709] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:50.496832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:50.499416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:50.567474 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba9ba2-a1c0-4600-9ef6-f31401ef355a service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:50.572255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:50.573166 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:50.573449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:50.573726 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] PATH_INFO: `/v3/users/96f7eb5295ad40df898f93f1505a7df7` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:50.574910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f7eb5295ad40df898f93f1505a7df7)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:50.576874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:50.628164 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f7eb5295ad40df898f93f1505a7df7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.636273 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f7eb5295ad40df898f93f1505a7df7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.636890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f7eb5295ad40df898f93f1505a7df7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.649094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f7eb5295ad40df898f93f1505a7df7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.653503 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:50.657528 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f7eb5295ad40df898f93f1505a7df7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.665475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1366/2710] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:50 2022] DELETE /identity/v3/users/96f7eb5295ad40df898f93f1505a7df7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:50.838996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:50.850911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7985c-3361-438d-a5f3-518f32ade5e5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:50.886290 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:50.912821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:50.913857 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:50.914206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:50.914568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] PATH_INFO: `/v3/projects/1d67075f4eaf4908acb0c2763153b81c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:50.915838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d67075f4eaf4908acb0c2763153b81c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:50.917802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:50.968495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d67075f4eaf4908acb0c2763153b81c', 'request_id': 'req-77db7ab3-a913-456e-b5e4-fda01005a96a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.976935 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d67075f4eaf4908acb0c2763153b81c', 'request_id': 'req-77db7ab3-a913-456e-b5e4-fda01005a96a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.983576 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d67075f4eaf4908acb0c2763153b81c', 'request_id': 'req-77db7ab3-a913-456e-b5e4-fda01005a96a'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.995429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] The token cache is being invalidate because project 1d67075f4eaf4908acb0c2763153b81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:50.995713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.996370 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:50.997931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1345/2711] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:50 2022] DELETE /identity/v3/projects/1d67075f4eaf4908acb0c2763153b81c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:51.002250 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:51.003523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:51.017349 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d551e-f723-4829-8830-85b76c8de01f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:51.073647 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:51.074514 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:51.074800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:51.075081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] PATH_INFO: `/v3/users/3efe09b6a1984af194301d61962838b9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:51.076259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efe09b6a1984af194301d61962838b9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:51.078272 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:51.134410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efe09b6a1984af194301d61962838b9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.142110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efe09b6a1984af194301d61962838b9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.142896 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efe09b6a1984af194301d61962838b9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.156575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efe09b6a1984af194301d61962838b9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.164597 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efe09b6a1984af194301d61962838b9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.170720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1367/2712] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:51 2022] DELETE /identity/v3/users/3efe09b6a1984af194301d61962838b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:51.374515 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:51.376067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:51.391206 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db7ab3-a913-456e-b5e4-fda01005a96a admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:51.455071 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:51.456894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:51.457190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:51.457480 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] PATH_INFO: `/v3/projects/fa05dd41597a451bb010745761640a7f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:51.458692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa05dd41597a451bb010745761640a7f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:51.460629 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:51.507848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa05dd41597a451bb010745761640a7f', 'request_id': 'req-118ae37d-e0ba-4bef-b9dd-d4ca42084527'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.514836 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa05dd41597a451bb010745761640a7f', 'request_id': 'req-118ae37d-e0ba-4bef-b9dd-d4ca42084527'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.521259 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa05dd41597a451bb010745761640a7f', 'request_id': 'req-118ae37d-e0ba-4bef-b9dd-d4ca42084527'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.526090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:51.533117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] The token cache is being invalidate because project fa05dd41597a451bb010745761640a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:51.533419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.534487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-118ae37d-e0ba-4bef-b9dd-d4ca42084527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:51.537000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1346/2713] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:51 2022] DELETE /identity/v3/projects/fa05dd41597a451bb010745761640a7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:57.792233 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:57.793838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:57.809968 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ff94-0308-41be-bd08-8aaf6054bb39 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:57.871602 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:57.872479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:57.872785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:57.873058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] PATH_INFO: `/v3/users/59304614d5da4324b5e37fc5e4d394c4` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:57.874225 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59304614d5da4324b5e37fc5e4d394c4)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:57.876157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:57.889525 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:57.923459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59304614d5da4324b5e37fc5e4d394c4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:57.930068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59304614d5da4324b5e37fc5e4d394c4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:57.930679 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59304614d5da4324b5e37fc5e4d394c4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:57.942858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59304614d5da4324b5e37fc5e4d394c4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:57.949677 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59304614d5da4324b5e37fc5e4d394c4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:57.955439 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1368/2714] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:57 2022] DELETE /identity/v3/users/59304614d5da4324b5e37fc5e4d394c4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:57.960438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:57.960925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:57.961047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:57.978897 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:57.980079 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:58.038510 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1347/2715] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:58.048322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:58.049853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:58.114985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434225-d4a2-4e2d-ab02-806340adee0a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:58.119083 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:58.119518 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:58.119672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:58.119930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:58.129834 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:58.131951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:58.141744 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1369/2716] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:16:58.497825 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:58.499654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:58.513631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d15d-423a-4846-baf6-38e1913febad None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:58.518539 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:58.519417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:58.519703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:58.519975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] PATH_INFO: `/v3/projects/6d4ead26a1cc489f9b110ded65854f97` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:58.522493 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4ead26a1cc489f9b110ded65854f97)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:58.524420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:58.577958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4ead26a1cc489f9b110ded65854f97', 'request_id': 'req-e34d6d96-b907-4804-834c-e7f16831cd8c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.586461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4ead26a1cc489f9b110ded65854f97', 'request_id': 'req-e34d6d96-b907-4804-834c-e7f16831cd8c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.592911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4ead26a1cc489f9b110ded65854f97', 'request_id': 'req-e34d6d96-b907-4804-834c-e7f16831cd8c'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.604156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] The token cache is being invalidate because project 6d4ead26a1cc489f9b110ded65854f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:58.604537 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.605116 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.606656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1348/2717] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:58 2022] DELETE /identity/v3/projects/6d4ead26a1cc489f9b110ded65854f97 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:16:58.610577 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:58.620490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f027d-edd7-4b02-b37a-d6d712a99a2d service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:58.684879 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:58.687054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:58.687343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:58.687619 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] PATH_INFO: `/v3/users/617c13efc2664fcfb0c542f804bfda4f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:58.688886 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617c13efc2664fcfb0c542f804bfda4f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:58.690817 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:58.730711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:58.741248 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617c13efc2664fcfb0c542f804bfda4f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.748816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617c13efc2664fcfb0c542f804bfda4f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.749539 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617c13efc2664fcfb0c542f804bfda4f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.770196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617c13efc2664fcfb0c542f804bfda4f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.779627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-41fc72a6-7b2f-4139-b0b0-2382a22fcf17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617c13efc2664fcfb0c542f804bfda4f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:58.786696 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1370/2718] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:16:58 2022] DELETE /identity/v3/users/617c13efc2664fcfb0c542f804bfda4f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:59.073410 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.074901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:59.090687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d6d96-b907-4804-834c-e7f16831cd8c admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.149267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.150129 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.150406 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.150677 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] PATH_INFO: `/v3/projects/5e93ba3e416f4bf39ebf2da58f1c2eea` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.151843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e93ba3e416f4bf39ebf2da58f1c2eea)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.153783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.175543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:59.199724 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e93ba3e416f4bf39ebf2da58f1c2eea', 'request_id': 'req-154ae725-8eb8-4b3d-aa03-16163aa161a9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:59.207036 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e93ba3e416f4bf39ebf2da58f1c2eea', 'request_id': 'req-154ae725-8eb8-4b3d-aa03-16163aa161a9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:59.214231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e93ba3e416f4bf39ebf2da58f1c2eea', 'request_id': 'req-154ae725-8eb8-4b3d-aa03-16163aa161a9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:59.225375 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] The token cache is being invalidate because project 5e93ba3e416f4bf39ebf2da58f1c2eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:16:59.225667 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:59.226300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-154ae725-8eb8-4b3d-aa03-16163aa161a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:16:59.227831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1349/2719] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:16:59 2022] DELETE /identity/v3/projects/5e93ba3e416f4bf39ebf2da58f1c2eea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:59.232702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.233192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.233410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.252461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:59.253635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:59.315343 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1371/2720] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:59.323748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.324031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.324307 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.343268 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:59.344464 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:59.353330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1350/2721] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:59.357593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.367703 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979c0c-90b6-4c41-a853-fd75834abe34 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.372443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.373147 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.373459 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.373734 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.374485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:16:59.374792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.376420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.388632 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1372/2722] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:16:59.393243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.403540 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4e884-7272-457a-bd4c-b7ec02b55ac5 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.411829 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.412800 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.413173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.413383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.414052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.415971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.442921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1351/2723] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:16:59.447194 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.457386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50f998-60de-4097-b31b-3dde8ffaddc1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.513860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.514430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.514716 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.514995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.515672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.517629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.544711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1373/2724] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:59.549740 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.561380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dc27c-8f21-44ca-8b1c-5dd6a3cb40f6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.566047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.566710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.566997 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.567279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.568636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.570278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.580642 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1352/2725] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:59.585137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.595155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec585f21-69a4-49c2-a936-c507d446d4a2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.600415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32d9e-5539-4441-9c05-3b6b4191e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.601134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32d9e-5539-4441-9c05-3b6b4191e90a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.601409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32d9e-5539-4441-9c05-3b6b4191e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.601687 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32d9e-5539-4441-9c05-3b6b4191e90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.602408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32d9e-5539-4441-9c05-3b6b4191e90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.604036 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32d9e-5539-4441-9c05-3b6b4191e90a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.613991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1374/2726] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:16:59.618592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.628523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ed4e-a92d-4da8-959c-3b824edb14fa admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.633527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.634434 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.634715 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.634988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] PATH_INFO: `/v3/projects/b491963b72ed43e3ba625cdd6fb0c57e/users/47a8ae6433f245d3aa62aa8a903a46e7/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.649772 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b491963b72ed43e3ba625cdd6fb0c57e, user_id=47a8ae6433f245d3aa62aa8a903a46e7, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.652469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.665405 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1353/2727] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:16:59 2022] PUT /identity/v3/projects/b491963b72ed43e3ba625cdd6fb0c57e/users/47a8ae6433f245d3aa62aa8a903a46e7/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:16:59.676398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.676859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.677998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.705557 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] MFA Rules not processed for user `47a8ae6433f245d3aa62aa8a903a46e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:16:59.706754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:16:59.714825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:16:59.772690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1375/2728] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:16:59.777061 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.838299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18bbb7-fc3f-4e3f-98fa-9a8369b5be1b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.842923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.843569 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.843846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.844117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.844826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.846769 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.876597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1354/2729] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:59.877564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.889687 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c0be7-8379-4f50-a150-7d94c00020eb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.946969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.947635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.947926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.948204 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.948915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.950831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:16:59.970826 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1376/2730] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:16:59 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:16:59.975059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:16:59.985459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e975d-1e63-430b-a2fc-55691cb6c5e2 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:16:59.990924 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:16:59.991606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:16:59.991895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:16:59.992172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:16:59.992931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:16:59.994523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:00.005523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1355/2731] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:00.009573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:00.019411 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4756dc-3db0-4596-875d-d23515ffe9c6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:00.024300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:00.025153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:00.025435 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:00.025708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] PATH_INFO: `/v3/projects/da01eb3183084e7bb0b7dbe66643ff8c/users/b2718a703f9a400280c02ab9b0d211a3/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:00.040380 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da01eb3183084e7bb0b7dbe66643ff8c, user_id=b2718a703f9a400280c02ab9b0d211a3, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:00.043080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:00.057372 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1377/2732] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:00 2022] PUT /identity/v3/projects/da01eb3183084e7bb0b7dbe66643ff8c/users/b2718a703f9a400280c02ab9b0d211a3/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:00.061559 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:00.072031 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a343ce-2bd8-44a5-a9e4-f5c7081bcd81 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:00.088513 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:00.129092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6257e9-ee93-415a-8e1c-c2143832edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:00.129768 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6257e9-ee93-415a-8e1c-c2143832edbd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:00.130745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6257e9-ee93-415a-8e1c-c2143832edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:00.131030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6257e9-ee93-415a-8e1c-c2143832edbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:00.131755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6257e9-ee93-415a-8e1c-c2143832edbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:00.133423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6257e9-ee93-415a-8e1c-c2143832edbd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:00.143156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1356/2733] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:00.147375 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:00.157449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86e06-9b2d-46fb-a2ac-8e93b24bffeb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:00.162051 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:00.162925 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:00.163209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:00.163485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] PATH_INFO: `/v3/projects/da01eb3183084e7bb0b7dbe66643ff8c/users/b2718a703f9a400280c02ab9b0d211a3/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:00.165420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da01eb3183084e7bb0b7dbe66643ff8c, user_id=b2718a703f9a400280c02ab9b0d211a3, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:00.168060 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:00.178737 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1378/2734] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:00 2022] PUT /identity/v3/projects/da01eb3183084e7bb0b7dbe66643ff8c/users/b2718a703f9a400280c02ab9b0d211a3/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:00.189026 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:00.189320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:00.189600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:00.224996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] MFA Rules not processed for user `b2718a703f9a400280c02ab9b0d211a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:00.226296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:00.294202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1357/2735] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:00.305607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:00.307379 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:00.363869 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d4b73-c079-4818-bf8e-28f748941a4b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:00.368202 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:00.368874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:00.369159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:00.369437 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:00.378361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:00.379802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:00.389082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1379/2736] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:00.466042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:00.476921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dba22-6218-47f2-8a5d-b11785121c05 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:00.481187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d443-ddd8-4eb7-8ab2-c1922fbf58ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:00.481820 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d443-ddd8-4eb7-8ab2-c1922fbf58ec service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:00.482131 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d443-ddd8-4eb7-8ab2-c1922fbf58ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:00.482467 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d443-ddd8-4eb7-8ab2-c1922fbf58ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:00.552472 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d443-ddd8-4eb7-8ab2-c1922fbf58ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:00.553932 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d443-ddd8-4eb7-8ab2-c1922fbf58ec service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:00.570632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1358/2737] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:05.884402 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:05.897161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:05.993491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0354a3-6952-4140-bca4-538ec55b3d83 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:05.998416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:05.999182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:05.999463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:05.999736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] PATH_INFO: `/v3/users/47a8ae6433f245d3aa62aa8a903a46e7` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:06.001192 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a8ae6433f245d3aa62aa8a903a46e7)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:06.003186 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:06.050723 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a8ae6433f245d3aa62aa8a903a46e7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.058025 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a8ae6433f245d3aa62aa8a903a46e7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.058639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a8ae6433f245d3aa62aa8a903a46e7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.071939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a8ae6433f245d3aa62aa8a903a46e7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.078884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a8ae6433f245d3aa62aa8a903a46e7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.084851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1380/2738] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:05 2022] DELETE /identity/v3/users/47a8ae6433f245d3aa62aa8a903a46e7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:06.089318 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:06.089824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:06.089931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:06.106727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:06.107940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:06.141802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:06.168144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1359/2739] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:06.178479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:06.179959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:06.241428 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74c139-c7d3-48e9-a8a9-316d868f1ffa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:06.245196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:06.245777 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:06.246063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:06.246338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:06.255874 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:06.257351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:06.266702 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1381/2740] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:17:06.538000 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:06.539794 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:06.557404 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa847ae1-8ca1-44ba-b8d6-5ec2ad8a1aa6 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:06.564534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:06.565497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:06.565804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:06.565975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] PATH_INFO: `/v3/projects/b491963b72ed43e3ba625cdd6fb0c57e` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:06.567627 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b491963b72ed43e3ba625cdd6fb0c57e)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:06.569604 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:06.623271 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b491963b72ed43e3ba625cdd6fb0c57e', 'request_id': 'req-198308c7-01de-44c0-9b41-be6837271e4e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.630158 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b491963b72ed43e3ba625cdd6fb0c57e', 'request_id': 'req-198308c7-01de-44c0-9b41-be6837271e4e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.636395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b491963b72ed43e3ba625cdd6fb0c57e', 'request_id': 'req-198308c7-01de-44c0-9b41-be6837271e4e'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.646793 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] The token cache is being invalidate because project b491963b72ed43e3ba625cdd6fb0c57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:06.647084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.647717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.649292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1360/2741] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:06 2022] DELETE /identity/v3/projects/b491963b72ed43e3ba625cdd6fb0c57e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:17:06.653224 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:06.663312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813c285-8038-4526-a576-e53e25aa3bee service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:06.688616 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:06.725405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:06.726269 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:06.726551 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:06.726825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] PATH_INFO: `/v3/users/b2718a703f9a400280c02ab9b0d211a3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:06.728013 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2718a703f9a400280c02ab9b0d211a3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:06.729993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:06.776115 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2718a703f9a400280c02ab9b0d211a3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.784303 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2718a703f9a400280c02ab9b0d211a3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.784910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2718a703f9a400280c02ab9b0d211a3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.798350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2718a703f9a400280c02ab9b0d211a3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.810849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-76ca60e9-45f0-438c-81ba-1b011f048749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2718a703f9a400280c02ab9b0d211a3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:06.817201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1382/2742] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:06 2022] DELETE /identity/v3/users/b2718a703f9a400280c02ab9b0d211a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:07.102222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.103862 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:07.118331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198308c7-01de-44c0-9b41-be6837271e4e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.180649 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.181607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.181899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.182179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] PATH_INFO: `/v3/projects/da01eb3183084e7bb0b7dbe66643ff8c` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.183381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da01eb3183084e7bb0b7dbe66643ff8c)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.185752 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.239128 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da01eb3183084e7bb0b7dbe66643ff8c', 'request_id': 'req-9d65db1a-0826-4b48-b277-e7b7490993a1'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:07.245509 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da01eb3183084e7bb0b7dbe66643ff8c', 'request_id': 'req-9d65db1a-0826-4b48-b277-e7b7490993a1'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:07.251795 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da01eb3183084e7bb0b7dbe66643ff8c', 'request_id': 'req-9d65db1a-0826-4b48-b277-e7b7490993a1'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:07.256342 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:07.264697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] The token cache is being invalidate because project da01eb3183084e7bb0b7dbe66643ff8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:07.265002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:07.265869 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9d65db1a-0826-4b48-b277-e7b7490993a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:07.267571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1361/2743] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:07 2022] DELETE /identity/v3/projects/da01eb3183084e7bb0b7dbe66643ff8c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:07.273141 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.273627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.273860 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.291300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:07.292590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:07.354547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1383/2744] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:07.362236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.362527 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.362810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.381533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:07.382731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:07.390483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1362/2745] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:07.394564 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.404844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c380ae9-0791-4acb-9733-47bc75e98f74 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.409440 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.410090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.410373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.410650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.411544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:17:07.411857 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.413492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.424990 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1384/2746] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:17:07.429437 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.438813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd71fb9-a139-4bed-bee3-1b10a36857fc None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.444139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.444821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.445105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.445379 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.446069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.447986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.473145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1363/2747] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:07 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:07.477169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.487231 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01179a-3113-45f7-b52c-46e7693c03c4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.517397 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:07.544995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.545639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.545920 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.546188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.546900 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.549237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.573080 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1385/2748] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:07 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:07.577100 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.587311 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2afeba-cffc-4e40-b2d6-e005fc23da0b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.591921 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.592599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.592923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.593196 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.593916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.595507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.605925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1364/2749] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:07.609779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.620500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2250c4-90b1-49ab-bd92-50bae6b54ae4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.625420 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d68837-ebd2-4aad-8652-13174ccf507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.626169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d68837-ebd2-4aad-8652-13174ccf507e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.626461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d68837-ebd2-4aad-8652-13174ccf507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.626745 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d68837-ebd2-4aad-8652-13174ccf507e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.627467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d68837-ebd2-4aad-8652-13174ccf507e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.629094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d68837-ebd2-4aad-8652-13174ccf507e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.639700 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1386/2750] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:07.643722 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.653780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5496d3-1428-48f9-8695-8d967e6e787e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.658497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.659390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.659669 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.659941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] PATH_INFO: `/v3/projects/d196fda79e464bbabea384532cf900bb/users/a5fedf948ac348a78028c27fc25b6bab/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.676252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d196fda79e464bbabea384532cf900bb, user_id=a5fedf948ac348a78028c27fc25b6bab, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.679891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.694274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1365/2751] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:07 2022] PUT /identity/v3/projects/d196fda79e464bbabea384532cf900bb/users/a5fedf948ac348a78028c27fc25b6bab/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:07.699263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b1722-7d90-4039-9e9c-f96e325f19a1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.699537 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b1722-7d90-4039-9e9c-f96e325f19a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.699821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b1722-7d90-4039-9e9c-f96e325f19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.717876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fa2b1722-7d90-4039-9e9c-f96e325f19a1 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:07.719064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fa2b1722-7d90-4039-9e9c-f96e325f19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:07.777498 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1387/2752] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:07.787090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:07.788798 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:07.847145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19bcc4-5e0c-4af7-88c6-3dae47a8a587 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:07.851822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:07.852473 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:07.852805 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:07.853072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:07.862511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:07.863887 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:07.874733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1366/2753] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:08.597377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:08.597996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:08.597996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:08.626358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] MFA Rules not processed for user `a5fedf948ac348a78028c27fc25b6bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:08.627572 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:08.701713 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1388/2754] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:08.706221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:08.716913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e882b56-5858-4124-91b1-18932d251205 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:08.721457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:08.722113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:08.722396 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:08.722703 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:08.724090 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:08.726126 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:08.757063 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1367/2755] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:08 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:08.758286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:08.769793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a82c4-eace-4cd8-9435-c576ae356ce3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:08.814654 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:08.833607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:08.834789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:08.835292 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:08.835793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:08.837078 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:08.840063 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:08.861153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1389/2756] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:08 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:08.865639 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:08.877252 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b049d8-f2e9-44a6-aa26-7210939e802d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:08.883551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:08.884227 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:08.884507 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:08.884810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:08.885545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:08.887161 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:08.906072 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1368/2757] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:17:08.908002 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:08.920256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b9b4-7500-480d-b29c-f7f6cd8d8089 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:08.925210 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:08.926329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:08.927606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:08.927606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] PATH_INFO: `/v3/projects/765f1b056a984181ae0f7a00a58ad69d/users/006a6a15eb814770b7ca638473286d53/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:08.957410 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] RBAC: Authorizing `identity:create_grant(project_id=765f1b056a984181ae0f7a00a58ad69d, user_id=006a6a15eb814770b7ca638473286d53, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:08.965357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:08.992101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1390/2758] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:08 2022] PUT /identity/v3/projects/765f1b056a984181ae0f7a00a58ad69d/users/006a6a15eb814770b7ca638473286d53/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:08.993550 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:09.010981 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f1719-b635-4c26-9590-3be17c2cb647 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:09.115555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc318f-053c-40c9-8d91-cd14063c8179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:09.116119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc318f-053c-40c9-8d91-cd14063c8179 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:09.116412 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc318f-053c-40c9-8d91-cd14063c8179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:09.116802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc318f-053c-40c9-8d91-cd14063c8179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:09.118230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc318f-053c-40c9-8d91-cd14063c8179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:09.121320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc318f-053c-40c9-8d91-cd14063c8179 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:09.123572 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:09.150231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1369/2759] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:09.154345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:09.175783 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7721ea-a3c8-4bec-b42c-f54fb456281c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:09.199519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97921278-3939-4921-876a-0fee295d8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:09.200655 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921278-3939-4921-876a-0fee295d8e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:09.200974 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921278-3939-4921-876a-0fee295d8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:09.201892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921278-3939-4921-876a-0fee295d8e04 admin admin] PATH_INFO: `/v3/projects/765f1b056a984181ae0f7a00a58ad69d/users/006a6a15eb814770b7ca638473286d53/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:09.206049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97921278-3939-4921-876a-0fee295d8e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765f1b056a984181ae0f7a00a58ad69d, user_id=006a6a15eb814770b7ca638473286d53, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:09.211804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97921278-3939-4921-876a-0fee295d8e04 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:09.228759 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1391/2760] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:09 2022] PUT /identity/v3/projects/765f1b056a984181ae0f7a00a58ad69d/users/006a6a15eb814770b7ca638473286d53/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:10.497741 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:10.498288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:10.498288 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:10.521014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:10.522287 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:10.544208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:10.544822 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:10.545062 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:10.610449 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] MFA Rules not processed for user `006a6a15eb814770b7ca638473286d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:10.611824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:10.645251 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1370/2761] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:17:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:10.709786 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:10.713413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:10.729175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1392/2762] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:10.742476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:10.743959 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:10.834849 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3efc6-714d-485a-96da-b5b09bc77a26 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:10.843802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9390d-f91d-415b-a0e9-1a72f1aff2d8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:10.850863 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:10.851659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:10.851942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:10.852215 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:10.854549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cd9ca-de86-4859-9686-d514c4fa12ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:10.854699 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cd9ca-de86-4859-9686-d514c4fa12ab service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:10.854995 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cd9ca-de86-4859-9686-d514c4fa12ab service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:10.855339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cd9ca-de86-4859-9686-d514c4fa12ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:10.882889 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cd9ca-de86-4859-9686-d514c4fa12ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:10.884755 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cd9ca-de86-4859-9686-d514c4fa12ab service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:10.900980 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1371/2763] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:17:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:17:10.923847 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:10.974930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:10.977244 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:10.992064 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1393/2764] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:11.681966 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafec667-65b1-414d-a214-b667705d28a6 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:11.682471 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafec667-65b1-414d-a214-b667705d28a6 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:11.682904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafec667-65b1-414d-a214-b667705d28a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:11.705089 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-cafec667-65b1-414d-a214-b667705d28a6 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:11.706295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cafec667-65b1-414d-a214-b667705d28a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:11.714180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1372/2765] 10.222.0.31 () {58 vars in 967 bytes} [Wed May 25 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:11.726950 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:11.740753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc7522-6004-4258-9c74-329ba128c6ff service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:11.746635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c40c55-3e24-42bf-b1f5-e3e3d591bf9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:11.747423 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c40c55-3e24-42bf-b1f5-e3e3d591bf9d service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:11.747885 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c40c55-3e24-42bf-b1f5-e3e3d591bf9d service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:11.748232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c40c55-3e24-42bf-b1f5-e3e3d591bf9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:11.759347 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c40c55-3e24-42bf-b1f5-e3e3d591bf9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:11.761209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c40c55-3e24-42bf-b1f5-e3e3d591bf9d service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:11.772100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1394/2766] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:17:11.888721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:11.888721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:11.888721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:11.907152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] MFA Rules not processed for user `47642301725e4023aba48b2a3a64d5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:11.908369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:11.969783 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1373/2767] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:12.011348 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adaa80-8952-400e-b9cd-4fbe3bb8961e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:12.011872 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adaa80-8952-400e-b9cd-4fbe3bb8961e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:12.012153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adaa80-8952-400e-b9cd-4fbe3bb8961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:12.032129 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-17adaa80-8952-400e-b9cd-4fbe3bb8961e None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:12.033396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-17adaa80-8952-400e-b9cd-4fbe3bb8961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:12.041389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1395/2768] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:17:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:12.054580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:12.069292 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4344e-318e-4f61-9985-0abc41212133 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:12.075029 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:12.075716 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:12.075999 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:12.076275 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:12.087645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:12.089300 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:12.102014 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1374/2769] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:17:12.466325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:12.466629 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:12.466916 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:12.471235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:12.472713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:12.486160 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38abe84-e7c1-4d36-98e1-b40710ba59be service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:12.487797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:12.489799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:12.490843 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:12.491568 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:12.491918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:12.492266 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:12.501039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1396/2770] 10.222.0.31 () {58 vars in 967 bytes} [Wed May 25 17:17:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:12.502964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:12.505947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:12.515676 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:12.516535 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1375/2771] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:17:12.529803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44dd8-4e2f-4161-b89c-c7d3785c3f92 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:12.534894 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:12.535582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:12.536595 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:12.537018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:12.547513 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:12.549412 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:12.561364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1397/2772] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 17:17:13.576052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:13.577534 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:13.584896 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:13.658557 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17624-fdba-4f39-b2c9-f0a5f5f8042e service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:13.664381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:13.665069 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:13.665394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:13.665618 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:13.667518 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:13.680211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:13.681891 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da29c05-d8a9-4997-9f38-1669931ed2d3 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:13.693463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1376/2773] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:14.779136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:14.780697 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:14.860207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e30dd6-dd1a-4980-a867-a7af540d4502 service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:14.865406 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:14.866284 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:14.866567 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:14.866855 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] PATH_INFO: `/v3/users/1ec72d8adbb84b32a74b3c85a260c6a2` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:14.868046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec72d8adbb84b32a74b3c85a260c6a2)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:14.870086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:14.919201 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec72d8adbb84b32a74b3c85a260c6a2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:14.926778 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec72d8adbb84b32a74b3c85a260c6a2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:14.927418 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec72d8adbb84b32a74b3c85a260c6a2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:14.940928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec72d8adbb84b32a74b3c85a260c6a2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:14.956160 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec72d8adbb84b32a74b3c85a260c6a2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:14.963969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1398/2774] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:14 2022] DELETE /identity/v3/users/1ec72d8adbb84b32a74b3c85a260c6a2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:14.968500 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:14.969006 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:14.969137 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:14.989341 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:14.991600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.015143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:15.019344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.045042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:15.096448 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1377/2775] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:15.108566 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:15.110085 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.144453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bf58-4281-4452-bd6a-24f31382cc3f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:15.151494 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:15.152545 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.152871 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.153291 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] PATH_INFO: `/v3/users/06fc6c6f43ad4c83baa0654b5f54e6d9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.154393 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fc6c6f43ad4c83baa0654b5f54e6d9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:15.156617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:15.228944 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be623fec-4156-4984-9005-4e0477ffc00d None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:15.235950 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33887b68-d9f5-45ef-80f7-303bcb5c32ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:15.236938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887b68-d9f5-45ef-80f7-303bcb5c32ea service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.237231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887b68-d9f5-45ef-80f7-303bcb5c32ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.237511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887b68-d9f5-45ef-80f7-303bcb5c32ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.249804 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33887b68-d9f5-45ef-80f7-303bcb5c32ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:15.251485 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33887b68-d9f5-45ef-80f7-303bcb5c32ea service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:15.259643 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fc6c6f43ad4c83baa0654b5f54e6d9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.262883 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1378/2776] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:15.288714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fc6c6f43ad4c83baa0654b5f54e6d9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.289522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fc6c6f43ad4c83baa0654b5f54e6d9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.331360 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fc6c6f43ad4c83baa0654b5f54e6d9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.345361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fc6c6f43ad4c83baa0654b5f54e6d9'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.360026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1399/2777] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:15 2022] DELETE /identity/v3/users/06fc6c6f43ad4c83baa0654b5f54e6d9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:15.361689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.361985 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.362265 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.402619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:15.403963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.438469 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:15.491835 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1379/2778] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:15.507206 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:15.509593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.602199 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd6e0-bfc1-4e6c-8066-8b32f06646b7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:15.631864 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62550-109a-41bc-bb45-aa24040820ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:15.633017 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62550-109a-41bc-bb45-aa24040820ed service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.633427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62550-109a-41bc-bb45-aa24040820ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.633809 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62550-109a-41bc-bb45-aa24040820ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.649368 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b62550-109a-41bc-bb45-aa24040820ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:15.650875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b62550-109a-41bc-bb45-aa24040820ed service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:15.663130 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:15.664954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.679118 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1400/2779] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:15.706183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f397a76-4cdc-45c3-a1e6-d67ac9dd8873 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:15.718494 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:15.720173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.721495 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.721938 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] PATH_INFO: `/v3/projects/cb64651a79ca496dbf2a79dba7e085ff` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.723390 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb64651a79ca496dbf2a79dba7e085ff)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:15.725810 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:15.784230 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb64651a79ca496dbf2a79dba7e085ff', 'request_id': 'req-03e92067-f06e-4302-8871-48b9995a6cda'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.794242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb64651a79ca496dbf2a79dba7e085ff', 'request_id': 'req-03e92067-f06e-4302-8871-48b9995a6cda'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.806279 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb64651a79ca496dbf2a79dba7e085ff', 'request_id': 'req-03e92067-f06e-4302-8871-48b9995a6cda'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.820176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] The token cache is being invalidate because project cb64651a79ca496dbf2a79dba7e085ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:15.820661 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.822848 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-03e92067-f06e-4302-8871-48b9995a6cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:15.825024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1380/2780] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:15 2022] DELETE /identity/v3/projects/cb64651a79ca496dbf2a79dba7e085ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:17:15.830282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.830789 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.831075 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.857457 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:15.858774 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.895591 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:15.932431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1401/2781] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:15.940975 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:15.941278 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:15.941561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:15.963432 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:15.964909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:15.975711 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1381/2782] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:15.979933 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:15.992057 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4754a1-6ce4-4c6c-b08f-331cc1410c28 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:15.999451 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.007918 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.008989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.009941 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.010797 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:17:16.011324 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.013327 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.058533 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1402/2783] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:17:16.062830 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.077996 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f714-6581-49df-adab-599f89e201a7 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.086142 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.086884 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.087170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.087457 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.088174 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.090545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.146995 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.159855 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1382/2784] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:16.175175 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1aa83-4ed8-42bd-b0b7-0a319ed51e16 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.202060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.204035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:16.276729 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.277421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.277711 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.277991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.278671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.281155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.308714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1403/2785] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:16.314365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.316420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d2cd-62bf-4628-9b3f-2d723bd78e53 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.329937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc3a92-3c6b-4b7f-b05a-41c44ad03704 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.331224 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.332105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.332429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.332846 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] PATH_INFO: `/v3/projects/6f29eecfa9984eb8aac53a21e25dc56f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.334178 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f29eecfa9984eb8aac53a21e25dc56f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.336171 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.336880 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.337842 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.338138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.338639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.339837 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.341708 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.358532 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1404/2786] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:17:16.359678 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.374091 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bacab-9c50-407c-bf74-d1359c2cd275 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.379649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.380467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.380790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.381096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.381792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.383337 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:16.383492 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.396009 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1405/2787] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:16.399944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.400218 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f29eecfa9984eb8aac53a21e25dc56f', 'request_id': 'req-9b4318a3-10f8-4571-8ddf-d43c04d30700'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:16.409868 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f29eecfa9984eb8aac53a21e25dc56f', 'request_id': 'req-9b4318a3-10f8-4571-8ddf-d43c04d30700'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:16.413753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262a1a7-f6c2-45dd-9153-b104ed87b746 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.417186 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f29eecfa9984eb8aac53a21e25dc56f', 'request_id': 'req-9b4318a3-10f8-4571-8ddf-d43c04d30700'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:16.429202 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] The token cache is being invalidate because project 6f29eecfa9984eb8aac53a21e25dc56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:16.429623 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:16.430419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9b4318a3-10f8-4571-8ddf-d43c04d30700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:16.432250 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1383/2788] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:16 2022] DELETE /identity/v3/projects/6f29eecfa9984eb8aac53a21e25dc56f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:16.437045 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de21b72-f8d2-41c9-86ae-021af541ff89 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.437732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de21b72-f8d2-41c9-86ae-021af541ff89 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.437732 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de21b72-f8d2-41c9-86ae-021af541ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.458733 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9de21b72-f8d2-41c9-86ae-021af541ff89 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:16.460172 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9de21b72-f8d2-41c9-86ae-021af541ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:16.484391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b3a6-90ca-4f0c-8ce2-efec21786929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.485239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b3a6-90ca-4f0c-8ce2-efec21786929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.485522 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b3a6-90ca-4f0c-8ce2-efec21786929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.485798 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b3a6-90ca-4f0c-8ce2-efec21786929 admin admin] PATH_INFO: `/v3/projects/195f7502e12548c5820b9b176a98b349/users/03703b61e1d3442aaf8346abb5159725/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.503803 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b3a6-90ca-4f0c-8ce2-efec21786929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195f7502e12548c5820b9b176a98b349, user_id=03703b61e1d3442aaf8346abb5159725, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.507185 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b3a6-90ca-4f0c-8ce2-efec21786929 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.524286 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1406/2789] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:16 2022] PUT /identity/v3/projects/195f7502e12548c5820b9b176a98b349/users/03703b61e1d3442aaf8346abb5159725/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 17:17:16.528096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1384/2790] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:16.529259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.529611 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.530004 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.536838 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.537421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.537885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.551558 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:16.552810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:16.563070 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:16.563251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:16.564531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:16.636745 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1385/2791] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:16.637753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.638120 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1407/2792] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:16.650220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.652336 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:16.654895 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497cbc-8fa7-4fab-8dcb-2c56c351ec79 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.662334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.663222 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.663698 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.664139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.665180 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:17:16.665652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.667442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.697190 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1386/2793] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:17:16.698314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.718364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5164-4fde-4363-94ac-4b3e96898236 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.724041 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.724958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.725276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.725730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.726579 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.728969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.746249 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb1ed2-baf3-4a04-95b3-a00eba7f4787 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.759502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.761143 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.761627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.762058 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.771209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1387/2794] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:16.776497 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.783608 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.785263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.798054 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1408/2795] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:16.848870 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:16.933286 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4989-908a-4a44-ae21-5226f0606544 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:16.951256 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:16.952425 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:16.952961 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:16.953429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:16.954438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:16.956647 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:16.981330 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1388/2796] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:16 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:16.985338 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:16.998934 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dfd50-cf7d-4e10-8540-e97c7bd35860 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:17.004617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:17.005680 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.006038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.006422 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.007239 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:17.009377 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:17.025704 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1409/2797] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:17.029796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:17.044762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba72f25-cfaf-40a6-ad23-a012a2f12f2b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:17.053917 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f975d-15cf-4bf9-8f29-673d8775c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:17.054721 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f975d-15cf-4bf9-8f29-673d8775c3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.055153 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f975d-15cf-4bf9-8f29-673d8775c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.055533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f975d-15cf-4bf9-8f29-673d8775c3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.056421 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f975d-15cf-4bf9-8f29-673d8775c3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:17.058183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f975d-15cf-4bf9-8f29-673d8775c3fd admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:17.070139 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1389/2798] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:17.074470 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:17.084455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b6ad5-fa06-4c3b-967c-cace6c71b3fc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:17.089232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:17.090134 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.092730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.092730 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] PATH_INFO: `/v3/projects/9cfb9666aa954c82a7908bc419678194/users/13397162d97049b1818c297ca26275ff/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.112263 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfb9666aa954c82a7908bc419678194, user_id=13397162d97049b1818c297ca26275ff, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:17.116505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:17.140079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1410/2799] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:17 2022] PUT /identity/v3/projects/9cfb9666aa954c82a7908bc419678194/users/13397162d97049b1818c297ca26275ff/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:17.141947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.142336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.142700 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.176866 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] MFA Rules not processed for user `13397162d97049b1818c297ca26275ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:17.181401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:17.274127 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1390/2800] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:17.284878 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:17.288005 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:17.366355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed497a1-6b31-4329-adcd-e4de1d71e56a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:17.370151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b686e-f8d0-4c3a-b85b-13f2fe9b9890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:17.370835 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b686e-f8d0-4c3a-b85b-13f2fe9b9890 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.371121 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b686e-f8d0-4c3a-b85b-13f2fe9b9890 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.371398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b686e-f8d0-4c3a-b85b-13f2fe9b9890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.380811 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b686e-f8d0-4c3a-b85b-13f2fe9b9890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:17.382257 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b686e-f8d0-4c3a-b85b-13f2fe9b9890 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:17.391433 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1411/2801] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:17.416002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:17.481879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddc9d3-c9c0-499b-9b68-926ab2541ef8 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:17.486632 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:17.487549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.487832 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.488111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] PATH_INFO: `/v3/users/13397162d97049b1818c297ca26275ff` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.489940 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13397162d97049b1818c297ca26275ff)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:17.491963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:17.554015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:17.566523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13397162d97049b1818c297ca26275ff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:17.568516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13397162d97049b1818c297ca26275ff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:17.569616 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13397162d97049b1818c297ca26275ff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:17.585417 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13397162d97049b1818c297ca26275ff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:17.595871 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13397162d97049b1818c297ca26275ff'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:17.613386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1391/2802] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:17 2022] DELETE /identity/v3/users/13397162d97049b1818c297ca26275ff => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:17.618444 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.618736 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.619082 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.639508 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:17.640972 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:17.667283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:17.727264 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1412/2803] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:17.734003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:17.735599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:17.813662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f55de-6e0e-4bf7-9d43-30979eeee472 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:17.817899 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820490-eba3-4e7c-846a-82992e7f51be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:17.818658 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820490-eba3-4e7c-846a-82992e7f51be service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:17.818977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820490-eba3-4e7c-846a-82992e7f51be service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:17.819254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820490-eba3-4e7c-846a-82992e7f51be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:17.831377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820490-eba3-4e7c-846a-82992e7f51be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:17.833179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820490-eba3-4e7c-846a-82992e7f51be service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:17.844992 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1392/2804] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:18.234022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.235624 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:18.255521 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87699b4-b0fd-4f06-a4e7-cef0f847d646 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.268596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.269571 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.269895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.270361 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] PATH_INFO: `/v3/projects/9cfb9666aa954c82a7908bc419678194` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.272140 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfb9666aa954c82a7908bc419678194)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.274157 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.349570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfb9666aa954c82a7908bc419678194', 'request_id': 'req-d286a474-4e2a-46ce-ae9e-19dfdc124371'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:18.359323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfb9666aa954c82a7908bc419678194', 'request_id': 'req-d286a474-4e2a-46ce-ae9e-19dfdc124371'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:18.367982 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfb9666aa954c82a7908bc419678194', 'request_id': 'req-d286a474-4e2a-46ce-ae9e-19dfdc124371'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:18.389442 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] The token cache is being invalidate because project 9cfb9666aa954c82a7908bc419678194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:18.389735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:18.390476 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d286a474-4e2a-46ce-ae9e-19dfdc124371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:18.392717 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1413/2805] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:18 2022] DELETE /identity/v3/projects/9cfb9666aa954c82a7908bc419678194 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:18.399486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.400774 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.401277 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.427219 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:18.428864 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:18.520809 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1393/2806] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:18.522490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.522781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.525011 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.550261 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:18.552426 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:18.562671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1414/2807] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:18.568331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.580034 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658aa1c-400c-4e6d-a091-2998e2f6c192 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.589176 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.589861 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.590143 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.590420 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.591159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:17:18.591483 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.593353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.610596 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.612841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1394/2808] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:17:18.621674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db2aa4-7ed8-4469-b229-e19abbd92ed5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.626535 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.627208 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.627493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.627776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.628461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.632074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.661840 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1415/2809] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:18 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:18.665876 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.679631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026887-0b89-43ed-a0cb-17eeae860214 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.759799 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:18.778427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.779585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.779585 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.779821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.780489 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.782486 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.806655 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1395/2810] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:18 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:18.811049 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.823135 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d5420-1e11-46d0-9e25-1685b1daf945 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.828733 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.829502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.830258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.830258 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.831007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.833391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.853209 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1416/2811] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:17:18.857654 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.870441 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506394d0-f46c-4f73-b3ed-1d3da8f41787 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.876511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71dfb6-180a-42fe-bcd1-3f7fcd1577b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.877223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71dfb6-180a-42fe-bcd1-3f7fcd1577b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.877503 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71dfb6-180a-42fe-bcd1-3f7fcd1577b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.877779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71dfb6-180a-42fe-bcd1-3f7fcd1577b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.878705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71dfb6-180a-42fe-bcd1-3f7fcd1577b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.881299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71dfb6-180a-42fe-bcd1-3f7fcd1577b8 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.900562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1396/2812] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:18.901460 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:18.923072 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017c971-d3cf-447c-bb72-bbf491f42aca admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:18.929456 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:18.930550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.930905 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.931268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] PATH_INFO: `/v3/projects/92f270a201c8498cb21520c1f7e2a775/users/ac1d17e50cf54b9faa5a5a0028ebf08d/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:18.950781 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f270a201c8498cb21520c1f7e2a775, user_id=ac1d17e50cf54b9faa5a5a0028ebf08d, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:18.953947 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:18.983350 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1417/2813] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:18 2022] PUT /identity/v3/projects/92f270a201c8498cb21520c1f7e2a775/users/ac1d17e50cf54b9faa5a5a0028ebf08d/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:18.993717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e49af-20a3-437e-8fe3-d77d14713268 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:18.994099 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e49af-20a3-437e-8fe3-d77d14713268 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:18.994459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e49af-20a3-437e-8fe3-d77d14713268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:19.025923 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-797e49af-20a3-437e-8fe3-d77d14713268 None None] MFA Rules not processed for user `ac1d17e50cf54b9faa5a5a0028ebf08d`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:19.027258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-797e49af-20a3-437e-8fe3-d77d14713268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:19.120847 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1397/2814] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:19.132480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:19.134648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:19.196237 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:19.215311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68880c-3b6f-4927-801e-66ba20e38de5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:19.219486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:19.220136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:19.220416 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:19.220701 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:19.231884 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:19.233553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:19.256232 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1418/2815] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:21.365723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.365723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.365723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.402481 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] MFA Rules not processed for user `03703b61e1d3442aaf8346abb5159725`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:21.405060 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:21.494555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1398/2816] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:21.498779 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:21.500255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:21.604000 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a441f4-ed6a-4d32-87b1-fca29d163aa0 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:21.609136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:21.610110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.610732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.611490 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.612408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:21.615052 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:21.642785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1419/2817] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:21 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:21.647827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:21.659461 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101247d-00f2-4ed2-8ac0-f3284129ede0 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:21.705599 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:21.724939 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:21.725690 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.726038 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.726377 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.727150 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:21.729187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:21.763839 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1399/2818] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:21 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:21.767951 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:21.778614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4b921-0e5b-4009-b19f-4740d06ee305 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:21.783163 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:21.783815 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.784094 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.784365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.785111 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:21.792480 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:21.804793 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1420/2819] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:21.809502 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:21.821359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f033e-8b49-4ed2-9151-5ad183a8e877 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:21.826235 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:21.827208 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.827487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.827758 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] PATH_INFO: `/v3/projects/cbc1a307200d4bd8bf7a9b8f1367436f/users/9312ea3c30f14170a89f881b5583dbcf/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.850042 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc1a307200d4bd8bf7a9b8f1367436f, user_id=9312ea3c30f14170a89f881b5583dbcf, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:21.852867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:21.868109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1400/2820] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:21 2022] PUT /identity/v3/projects/cbc1a307200d4bd8bf7a9b8f1367436f/users/9312ea3c30f14170a89f881b5583dbcf/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:21.872241 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:21.883727 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b997e3-bc87-4f6d-9c5c-c580fd88a7b8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:21.954634 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:21.955317 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.955605 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.955887 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.956752 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:21.958989 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:21.970322 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1421/2821] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:21.975223 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:21.986168 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a800764-58f0-428b-9055-604ea3bba458 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:21.991879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:21.992754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:21.993043 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:21.993320 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] PATH_INFO: `/v3/projects/cbc1a307200d4bd8bf7a9b8f1367436f/users/9312ea3c30f14170a89f881b5583dbcf/roles/bf0c64aece024dff9ecbdf6d367236fe` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:21.995501 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc1a307200d4bd8bf7a9b8f1367436f, user_id=9312ea3c30f14170a89f881b5583dbcf, role_id=bf0c64aece024dff9ecbdf6d367236fe)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:21.998232 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:22.014112 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1401/2822] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:21 2022] PUT /identity/v3/projects/cbc1a307200d4bd8bf7a9b8f1367436f/users/9312ea3c30f14170a89f881b5583dbcf/roles/bf0c64aece024dff9ecbdf6d367236fe => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:27.731890 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:27.734171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:27.776351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298449b-387b-4f7b-84c7-07ba2bf11020 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:27.916448 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:27.930805 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:27.931998 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:27.933404 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:27.933792 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] PATH_INFO: `/v3/users/a5fedf948ac348a78028c27fc25b6bab` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:27.935635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fedf948ac348a78028c27fc25b6bab)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:27.938195 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:28.088184 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fedf948ac348a78028c27fc25b6bab'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.126547 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fedf948ac348a78028c27fc25b6bab'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.127169 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fedf948ac348a78028c27fc25b6bab'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.156648 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fedf948ac348a78028c27fc25b6bab'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.179892 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e51743dd-7d35-4a32-84b2-d832b3f4c3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fedf948ac348a78028c27fc25b6bab'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.208276 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1422/2823] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:27 2022] DELETE /identity/v3/users/a5fedf948ac348a78028c27fc25b6bab => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:28.523173 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:28.526221 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:28.543796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0951c9-7e63-4b04-a714-29cdb3140c6b admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:28.572810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:28.573096 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:28.573621 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:28.616074 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] MFA Rules not processed for user `9312ea3c30f14170a89f881b5583dbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:28.617694 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:28.631662 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:28.633207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:28.633207 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:28.633746 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] PATH_INFO: `/v3/projects/d196fda79e464bbabea384532cf900bb` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:28.635145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d196fda79e464bbabea384532cf900bb)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:28.637258 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:28.716652 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1423/2824] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:28.731555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:28.732904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd196fda79e464bbabea384532cf900bb', 'request_id': 'req-ee8c9055-9c83-4509-a4bc-bb9426dc4575'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.736881 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:28.744429 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd196fda79e464bbabea384532cf900bb', 'request_id': 'req-ee8c9055-9c83-4509-a4bc-bb9426dc4575'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.756819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd196fda79e464bbabea384532cf900bb', 'request_id': 'req-ee8c9055-9c83-4509-a4bc-bb9426dc4575'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.770124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] The token cache is being invalidate because project d196fda79e464bbabea384532cf900bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:28.770790 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.771960 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.774496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1402/2825] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:28 2022] DELETE /identity/v3/projects/d196fda79e464bbabea384532cf900bb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:28.778177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:28.780468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:28.831477 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38071c-668b-4acf-8c1d-26e4b6ed2842 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:28.837851 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:28.857161 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:28.893242 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9055-9c83-4509-a4bc-bb9426dc4575 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:28.899035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:28.900514 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:28.901009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:28.901444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] PATH_INFO: `/v3/users/006a6a15eb814770b7ca638473286d53` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:28.902918 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006a6a15eb814770b7ca638473286d53)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:28.903670 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:28.904431 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:28.904853 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:28.905227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:28.906166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:28.907467 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:28.978709 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006a6a15eb814770b7ca638473286d53'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.979426 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006a6a15eb814770b7ca638473286d53'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.980062 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006a6a15eb814770b7ca638473286d53'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:28.994273 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006a6a15eb814770b7ca638473286d53'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.002022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006a6a15eb814770b7ca638473286d53'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.003398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.005731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cee853-15e5-4c57-9bcc-45f39bb60a38 service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.016728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1424/2826] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:29.018597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1403/2827] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:28 2022] DELETE /identity/v3/users/006a6a15eb814770b7ca638473286d53 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:29.134657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.135014 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.135369 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.195461 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:29.198344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:29.240911 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:29.242369 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:29.303290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1425/2828] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:29.320027 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:29.321722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:29.339141 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7a010-f55a-4711-93b3-c6653514d688 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:29.346729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:29.347978 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.348351 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.348727 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] PATH_INFO: `/v3/projects/765f1b056a984181ae0f7a00a58ad69d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.350037 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765f1b056a984181ae0f7a00a58ad69d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.351991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.403374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:29.407971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765f1b056a984181ae0f7a00a58ad69d', 'request_id': 'req-6508c333-4ff6-408f-9777-5b49546458c3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.414843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb058-c2a3-423c-a99e-0ffc301ab2df None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:29.421823 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765f1b056a984181ae0f7a00a58ad69d', 'request_id': 'req-6508c333-4ff6-408f-9777-5b49546458c3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.429231 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765f1b056a984181ae0f7a00a58ad69d', 'request_id': 'req-6508c333-4ff6-408f-9777-5b49546458c3'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.436865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:29.441067 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] The token cache is being invalidate because project 765f1b056a984181ae0f7a00a58ad69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:29.441211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.442009 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-6508c333-4ff6-408f-9777-5b49546458c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:29.443551 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1404/2829] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:29 2022] DELETE /identity/v3/projects/765f1b056a984181ae0f7a00a58ad69d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:29.448267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d22a7-9aec-41bf-9574-b6744054e548 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.448560 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d22a7-9aec-41bf-9574-b6744054e548 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.449254 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d22a7-9aec-41bf-9574-b6744054e548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.469329 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-391d22a7-9aec-41bf-9574-b6744054e548 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:29.470563 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-391d22a7-9aec-41bf-9574-b6744054e548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:29.490068 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:29.490843 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.491028 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.491278 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.493165 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:29.558913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1405/2830] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:29.569433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.569853 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.570240 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.601432 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.605569 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.606058 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:29.607641 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:29.620132 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1406/2831] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:29.624126 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1426/2832] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:17:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 17:17:29.624403 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:29.635442 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334564ad-1e55-4619-9532-b790b9b87191 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:29.652331 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:29.653293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.653477 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.653756 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.654496 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:17:29.654930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.656635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.687934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1407/2833] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 17:17:29.689926 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:29.711109 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab22f-5f6a-4eeb-927d-6cdbee04bd07 service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:29.720570 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:29.722079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.726312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.726756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.727686 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.736594 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.802316 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1427/2834] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:29 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:17:29.804401 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:29.816022 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d581646-7b89-4596-bf70-ef9d0f744814 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:29.906187 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:29.907030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.907428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.907814 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.908589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.912243 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.948317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1408/2835] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:29 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:29.951999 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:29.967090 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499f461-9163-44bd-ae1e-7b5f24082bb1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:29.974966 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:29.976587 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:29.977802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:29.977802 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:29.978536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:29.980268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:29.998955 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1428/2836] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:30.000549 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:30.022963 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619794-933c-42bd-83d8-1741e7f42e88 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:30.030418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b06a6-7f94-4c99-8b03-ccf33292cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:30.031111 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b06a6-7f94-4c99-8b03-ccf33292cb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:30.031397 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b06a6-7f94-4c99-8b03-ccf33292cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:30.031679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b06a6-7f94-4c99-8b03-ccf33292cb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:30.033423 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b06a6-7f94-4c99-8b03-ccf33292cb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:30.038858 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b06a6-7f94-4c99-8b03-ccf33292cb1d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:30.052001 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1409/2837] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:30.055882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:30.069862 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2849b6-8b76-40b2-b83d-c2ca851683b8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:30.077584 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:30.078776 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:30.079409 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:30.079913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] PATH_INFO: `/v3/projects/421bc4cecf8142e5bb53f6bcd8391c58/users/93412c9aabd848cf98b98c1ef8222f29/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:30.099706 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421bc4cecf8142e5bb53f6bcd8391c58, user_id=93412c9aabd848cf98b98c1ef8222f29, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:30.112582 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:30.160784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1429/2838] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:30 2022] PUT /identity/v3/projects/421bc4cecf8142e5bb53f6bcd8391c58/users/93412c9aabd848cf98b98c1ef8222f29/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:30.163676 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:30.164053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:30.164332 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:30.286145 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] MFA Rules not processed for user `93412c9aabd848cf98b98c1ef8222f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:30.287310 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:30.327665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:30.460706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1410/2839] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:30.475330 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:30.477384 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:30.599993 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73638-a97f-4d4b-9352-fbaf4c978e20 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:30.603719 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1d607-c8b4-40b0-993a-f62e9f357c23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e29e245b61634d66bcca79fe530c6019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:30.604386 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d607-c8b4-40b0-993a-f62e9f357c23 service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:30.604859 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d607-c8b4-40b0-993a-f62e9f357c23 service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:30.605139 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d607-c8b4-40b0-993a-f62e9f357c23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:30.630398 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1d607-c8b4-40b0-993a-f62e9f357c23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:30.632516 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1d607-c8b4-40b0-993a-f62e9f357c23 service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:30.656345 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1430/2840] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:32.043762 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:32.045335 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:32.156833 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9b9f4-8af6-465c-99d0-b247277bd614 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:32.160948 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:32.162841 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:32.163280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:32.163635 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] PATH_INFO: `/v3/users/ac1d17e50cf54b9faa5a5a0028ebf08d` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:32.165167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1d17e50cf54b9faa5a5a0028ebf08d)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:32.167211 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:32.241885 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1d17e50cf54b9faa5a5a0028ebf08d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:32.242909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1d17e50cf54b9faa5a5a0028ebf08d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:32.243554 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1d17e50cf54b9faa5a5a0028ebf08d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:32.262444 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1d17e50cf54b9faa5a5a0028ebf08d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:32.270730 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1d17e50cf54b9faa5a5a0028ebf08d'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:32.291613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1411/2841] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:32 2022] DELETE /identity/v3/users/ac1d17e50cf54b9faa5a5a0028ebf08d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:32.298722 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:32.299220 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:32.299315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:32.320312 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:32.331363 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:32.332649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:32.428084 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1431/2842] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:32.453673 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:32.458779 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:32.595695 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:32.621929 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16442f84-e58b-4a94-97f6-28080f602e0e admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:32.637511 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491bd8-de5b-43ff-aeae-a1690e6dac23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:32.638308 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491bd8-de5b-43ff-aeae-a1690e6dac23 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:32.638678 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491bd8-de5b-43ff-aeae-a1690e6dac23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:32.639027 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491bd8-de5b-43ff-aeae-a1690e6dac23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:32.651408 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491bd8-de5b-43ff-aeae-a1690e6dac23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:32.653570 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491bd8-de5b-43ff-aeae-a1690e6dac23 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:32.670381 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1412/2843] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:33.112279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:33.112505 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:33.183290 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e26f6-b705-4b42-9382-24c0024c1e65 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:33.202593 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:33.203500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:33.203775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:33.204207 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] PATH_INFO: `/v3/projects/92f270a201c8498cb21520c1f7e2a775` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:33.205682 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f270a201c8498cb21520c1f7e2a775)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:33.209487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:33.315732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f270a201c8498cb21520c1f7e2a775', 'request_id': 'req-c13fb2a3-104f-457e-a1e2-4784405ca31a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:33.339768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f270a201c8498cb21520c1f7e2a775', 'request_id': 'req-c13fb2a3-104f-457e-a1e2-4784405ca31a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:33.349300 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f270a201c8498cb21520c1f7e2a775', 'request_id': 'req-c13fb2a3-104f-457e-a1e2-4784405ca31a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:33.381743 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] The token cache is being invalidate because project 92f270a201c8498cb21520c1f7e2a775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:33.382251 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:33.383079 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c13fb2a3-104f-457e-a1e2-4784405ca31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:33.385928 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1432/2844] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:33 2022] DELETE /identity/v3/projects/92f270a201c8498cb21520c1f7e2a775 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:40.500754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:40.501154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:40.501317 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:40.520119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] MFA Rules not processed for user `03703b61e1d3442aaf8346abb5159725`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:40.521374 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:40.577102 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1413/2845] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:42.389790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:42.390541 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:42.390663 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:42.410555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:42.412050 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:42.467761 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1433/2846] 10.222.0.31 () {58 vars in 1009 bytes} [Wed May 25 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:42.480819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:42.482326 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:42.562438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13ef7-e2ac-4ea3-8bbf-a6e36cce8530 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:42.567643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba25a-1ea8-4cee-a3bf-379bc87e7a42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:42.568298 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba25a-1ea8-4cee-a3bf-379bc87e7a42 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:42.568617 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba25a-1ea8-4cee-a3bf-379bc87e7a42 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:42.568934 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba25a-1ea8-4cee-a3bf-379bc87e7a42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:42.577345 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba25a-1ea8-4cee-a3bf-379bc87e7a42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:42.578964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba25a-1ea8-4cee-a3bf-379bc87e7a42 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:42.587393 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1414/2847] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 17:17:46.815969 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:46.817985 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:46.862675 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:46.902136 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1aba-df6b-4981-9db8-d13948f57c81 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:46.906852 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:46.907851 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:46.908259 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:46.908642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] PATH_INFO: `/v3/users/93412c9aabd848cf98b98c1ef8222f29` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:46.910364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=93412c9aabd848cf98b98c1ef8222f29)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:46.913768 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:47.012144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93412c9aabd848cf98b98c1ef8222f29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.025137 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93412c9aabd848cf98b98c1ef8222f29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.025387 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93412c9aabd848cf98b98c1ef8222f29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.040585 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93412c9aabd848cf98b98c1ef8222f29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.047865 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93412c9aabd848cf98b98c1ef8222f29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.057153 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1434/2848] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:17:46 2022] DELETE /identity/v3/users/93412c9aabd848cf98b98c1ef8222f29 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:47.062047 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.062597 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.062930 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.081166 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:47.082528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:47.150189 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1415/2849] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:47.160502 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:47.162039 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:47.228816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62e52-29ea-4cd5-bdd8-e381f29812ab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:47.232799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bdd51-ad09-4490-b821-a6af03460702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:47.233486 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bdd51-ad09-4490-b821-a6af03460702 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.233767 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bdd51-ad09-4490-b821-a6af03460702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.234044 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bdd51-ad09-4490-b821-a6af03460702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.246453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bdd51-ad09-4490-b821-a6af03460702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:47.247910 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bdd51-ad09-4490-b821-a6af03460702 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:47.262015 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1435/2850] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:47.554147 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:47.555589 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:47.570249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533631-704c-4a26-8cd2-133f208b3899 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:47.584531 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:47.585418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.585702 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.585965 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] PATH_INFO: `/v3/projects/421bc4cecf8142e5bb53f6bcd8391c58` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.587170 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=421bc4cecf8142e5bb53f6bcd8391c58)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:47.589152 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:47.609463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:47.648002 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421bc4cecf8142e5bb53f6bcd8391c58', 'request_id': 'req-0af56d10-f4c6-4215-9234-1064695db8ca'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.658909 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421bc4cecf8142e5bb53f6bcd8391c58', 'request_id': 'req-0af56d10-f4c6-4215-9234-1064695db8ca'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.667697 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421bc4cecf8142e5bb53f6bcd8391c58', 'request_id': 'req-0af56d10-f4c6-4215-9234-1064695db8ca'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.681118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] The token cache is being invalidate because project 421bc4cecf8142e5bb53f6bcd8391c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:17:47.681547 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.682324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-0af56d10-f4c6-4215-9234-1064695db8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:17:47.684719 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1416/2851] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:17:47 2022] DELETE /identity/v3/projects/421bc4cecf8142e5bb53f6bcd8391c58 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:47.691019 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.691543 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.692018 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.713485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:47.715101 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:47.776962 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:47.789355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1436/2852] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:47.797436 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4081a8-a821-4151-9834-92395c130982 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.797729 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4081a8-a821-4151-9834-92395c130982 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.798015 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4081a8-a821-4151-9834-92395c130982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.820771 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-0d4081a8-a821-4151-9834-92395c130982 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:47.822364 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-0d4081a8-a821-4151-9834-92395c130982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:47.830611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1417/2853] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 17:17:47.835604 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:47.847978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e387d-e61b-4b6e-99d7-8e67e21ee5d9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:47.852667 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:47.853443 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.853728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.854003 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.854728 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:17:47.855038 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:47.856671 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:47.872382 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1437/2854] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:17:47.874791 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4081a8-a821-4151-9834-92395c130982 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:47.885284 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4081a8-a821-4151-9834-92395c130982 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:47.890162 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:47.890826 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:47.891109 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:47.891382 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:47.892117 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:47.894971 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:47.922723 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1418/2855] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:17:47 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:47.926991 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:47.939784 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6738-73f6-46d5-8f91-a4e200bb754e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:48.001832 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:48.002617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:48.002912 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:48.004536 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:48.005304 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:48.007415 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:48.026520 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1438/2856] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:17:47 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 17:17:48.030751 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:48.045297 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3741fa-a060-4440-ba26-1eb5c67a2a63 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:48.050689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:48.051606 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:48.051890 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:48.052167 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:48.052925 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:48.054542 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:48.070274 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1419/2857] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:17:48.072850 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:48.084405 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819ec3e-136f-4003-acd6-147968b4e80a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:48.089242 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e423b95-d06b-4616-bcc7-799686128edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:48.089913 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e423b95-d06b-4616-bcc7-799686128edc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:48.090332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e423b95-d06b-4616-bcc7-799686128edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:48.090617 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e423b95-d06b-4616-bcc7-799686128edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:48.091344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e423b95-d06b-4616-bcc7-799686128edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:48.093601 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e423b95-d06b-4616-bcc7-799686128edc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:48.110487 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1439/2858] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 17:17:48.115138 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:48.126528 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d132-a609-4137-950d-b73a962a3253 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:48.133979 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:48.134990 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:48.135334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:48.136156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] PATH_INFO: `/v3/projects/dceff4afa8b24293bdc46f0386232b69/users/3b76527e347f4b88b500d8932fffb682/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:48.153797 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dceff4afa8b24293bdc46f0386232b69, user_id=3b76527e347f4b88b500d8932fffb682, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:48.157619 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:48.172705 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1420/2859] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:17:48 2022] PUT /identity/v3/projects/dceff4afa8b24293bdc46f0386232b69/users/3b76527e347f4b88b500d8932fffb682/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:17:48.185408 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:48.185931 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:48.186373 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:48.225563 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] MFA Rules not processed for user `3b76527e347f4b88b500d8932fffb682`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:17:48.227081 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:48.320714 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1440/2860] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:17:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:17:48.333753 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:17:48.335512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:17:48.403530 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c244-c76a-4108-ae10-4cba640d972f admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:17:48.407353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240077-f036-40a9-b0cc-7989378fe25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:17:48.408051 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240077-f036-40a9-b0cc-7989378fe25e service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:17:48.408354 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240077-f036-40a9-b0cc-7989378fe25e service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:17:48.408633 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240077-f036-40a9-b0cc-7989378fe25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:17:48.419428 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49240077-f036-40a9-b0cc-7989378fe25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:17:48.420926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49240077-f036-40a9-b0cc-7989378fe25e service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:17:48.431561 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1421/2861] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:17:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:17:58.314882 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:17:58.427214 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:07.303255 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:07.374046 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575bb21-649d-429e-a467-db9410ed9d96 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:07.378709 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:07.380283 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:07.380565 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:07.380858 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] PATH_INFO: `/v3/users/3b76527e347f4b88b500d8932fffb682` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:07.382053 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b76527e347f4b88b500d8932fffb682)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:07.383978 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:07.428282 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b76527e347f4b88b500d8932fffb682'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:07.435659 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b76527e347f4b88b500d8932fffb682'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:07.436226 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b76527e347f4b88b500d8932fffb682'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:07.449197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b76527e347f4b88b500d8932fffb682'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:07.455867 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b76527e347f4b88b500d8932fffb682'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:07.462475 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1441/2862] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:18:07 2022] DELETE /identity/v3/users/3b76527e347f4b88b500d8932fffb682 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:18:07.467052 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:07.467543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:07.467679 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:07.484541 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:18:07.485947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:07.547082 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1422/2863] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:18:07.559086 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:07.560939 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:07.621103 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe769b84-46a2-4d49-8e81-64cf1651e8f5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:07.625268 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6351-cc68-4bd4-b919-69efd4c0213d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:07.625915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6351-cc68-4bd4-b919-69efd4c0213d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:07.626200 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6351-cc68-4bd4-b919-69efd4c0213d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:07.626478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6351-cc68-4bd4-b919-69efd4c0213d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:07.636500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f6351-cc68-4bd4-b919-69efd4c0213d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:07.637981 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f6351-cc68-4bd4-b919-69efd4c0213d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:07.647544 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1442/2864] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:18:07.927392 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:07.928827 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:07.940976 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2d303-3a2a-4c3e-9d58-880a7870e5ea None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:07.946146 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:07.947054 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:07.947336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:07.947609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] PATH_INFO: `/v3/projects/dceff4afa8b24293bdc46f0386232b69` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:07.948819 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dceff4afa8b24293bdc46f0386232b69)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:07.950813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:07.997720 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dceff4afa8b24293bdc46f0386232b69', 'request_id': 'req-f2bed9d5-0921-41dd-8636-6be493e84692'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:08.005080 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dceff4afa8b24293bdc46f0386232b69', 'request_id': 'req-f2bed9d5-0921-41dd-8636-6be493e84692'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:08.011575 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dceff4afa8b24293bdc46f0386232b69', 'request_id': 'req-f2bed9d5-0921-41dd-8636-6be493e84692'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:08.022184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] The token cache is being invalidate because project dceff4afa8b24293bdc46f0386232b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:18:08.022516 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:08.023154 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-f2bed9d5-0921-41dd-8636-6be493e84692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:08.024964 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1423/2865] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:18:07 2022] DELETE /identity/v3/projects/dceff4afa8b24293bdc46f0386232b69 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:18:08.029875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.030182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.030485 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.048396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:18:08.049628 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:08.067674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:08.112344 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1443/2866] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:18:08.120731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.121024 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.121304 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.139986 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.auth.core [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:18:08.141301 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:08.149506 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1424/2867] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:18:08.153756 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.164414 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17a823-cd72-4e52-9c8f-e88c1a496b31 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.168964 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.169607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.169893 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.170171 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.170889 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 17:18:08.171196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.172844 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.185838 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1444/2868] 10.222.0.31 () {58 vars in 1152 bytes} [Wed May 25 17:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 17:18:08.189822 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.199118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b78bc-223c-4d26-99cf-292ba55e2f18 None None] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.203808 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.204459 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] REQUEST_METHOD: `POST` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.204777 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.205059 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.205743 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.208181 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.233359 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1425/2869] 10.222.0.31 () {60 vars in 1152 bytes} [Wed May 25 17:18:08 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:18:08.237213 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.247942 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d724e-880c-48b6-8fc2-04d1363f39c2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.307325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.307996 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.308279 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.308555 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.309267 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.311639 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.334689 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1445/2870] 10.222.0.31 () {60 vars in 1143 bytes} [Wed May 25 17:18:08 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 17:18:08.339032 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.350409 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bffc3-ef82-4371-9690-0086dad60566 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.355065 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.355726 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.356013 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.356295 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.357053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.358671 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.369182 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1426/2871] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:18:08.373298 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.383583 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cf8b-defe-44d5-8bdd-ad89574eae48 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.388240 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f76764-a797-4e40-bb8f-92b38e4ae17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.388930 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76764-a797-4e40-bb8f-92b38e4ae17b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.389218 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76764-a797-4e40-bb8f-92b38e4ae17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.389500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76764-a797-4e40-bb8f-92b38e4ae17b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.390221 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76764-a797-4e40-bb8f-92b38e4ae17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.391824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76764-a797-4e40-bb8f-92b38e4ae17b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.402146 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1446/2872] 10.222.0.31 () {58 vars in 1121 bytes} [Wed May 25 17:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 17:18:08.406124 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.416529 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4542-3c4a-419b-bc49-f1e9d3706492 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.421249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.422125 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] REQUEST_METHOD: `PUT` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.422413 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.422691 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] PATH_INFO: `/v3/projects/04536fa2125b43a898797bc78f0acf40/users/c765f52124c645dcbce57877deb183bc/roles/81e2b7e27546405389402bc4b6987138` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.437555 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04536fa2125b43a898797bc78f0acf40, user_id=c765f52124c645dcbce57877deb183bc, role_id=81e2b7e27546405389402bc4b6987138)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.440215 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.453763 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1427/2873] 10.222.0.31 () {60 vars in 1482 bytes} [Wed May 25 17:18:08 2022] PUT /identity/v3/projects/04536fa2125b43a898797bc78f0acf40/users/c765f52124c645dcbce57877deb183bc/roles/81e2b7e27546405389402bc4b6987138 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:18:08.465799 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.466098 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.466381 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.494110 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] MFA Rules not processed for user `c765f52124c645dcbce57877deb183bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:18:08.495320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:08.560311 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1447/2874] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:18:08.572336 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:08.574210 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:08.596916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:08.634107 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943422e8-1fe2-44c5-ac3d-cc464cda221d admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:08.637913 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:08.638562 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:08.638845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:08.639122 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:08.648523 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:08.649991 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:08.658628 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1428/2875] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:18:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:18:16.140007 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:16.141635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:16.174059 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:16.219365 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f789-c08d-4219-8cbe-1e7c3fc017ed None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:16.222997 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:16.223650 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:16.224453 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:16.225355 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:16.227177 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:16.294288 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:16.295796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a3ad4-fae5-4858-8487-045b8751997d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:16.306769 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1448/2876] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:18:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:18:18.654689 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=17 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:24.976119 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:25.038754 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e51d04-fcea-4f2c-8337-a6eb688ef6b1 service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:25.043487 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:25.044360 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:25.044644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:25.044956 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] PATH_INFO: `/v3/users/c765f52124c645dcbce57877deb183bc` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:25.046140 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c765f52124c645dcbce57877deb183bc)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:25.048083 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:25.094033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c765f52124c645dcbce57877deb183bc'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.094693 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c765f52124c645dcbce57877deb183bc'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.095296 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c765f52124c645dcbce57877deb183bc'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.107665 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c765f52124c645dcbce57877deb183bc'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.114355 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c765f52124c645dcbce57877deb183bc'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.127644 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1429/2877] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:18:24 2022] DELETE /identity/v3/users/c765f52124c645dcbce57877deb183bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:18:25.132357 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:25.132883 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:25.133006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:25.150227 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] MFA Rules not processed for user `cc4dc5eccddf4937ae7c342c241f1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:18:25.151427 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:25.211642 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1449/2878] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:18:25.221159 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:25.222580 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:25.281380 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d0f1-25b5-4074-84f0-2f72e6aa53b6 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:25.285092 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:25.285736 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:25.286017 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:25.286293 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:25.296236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:25.297706 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:25.307916 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1430/2879] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:18:25.580638 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:18:25.582155 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:18:25.596479 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d129a7-e6d3-47f2-895d-225c3d20274f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:18:25.602500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:18:25.603389 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:18:25.603672 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:18:25.603952 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] PATH_INFO: `/v3/projects/04536fa2125b43a898797bc78f0acf40` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:18:25.605217 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04536fa2125b43a898797bc78f0acf40)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:18:25.607329 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:18:25.654984 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04536fa2125b43a898797bc78f0acf40', 'request_id': 'req-b9cd42af-7e99-4ecd-8622-645f8d15f48f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.661123 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04536fa2125b43a898797bc78f0acf40', 'request_id': 'req-b9cd42af-7e99-4ecd-8622-645f8d15f48f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.668501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04536fa2125b43a898797bc78f0acf40', 'request_id': 'req-b9cd42af-7e99-4ecd-8622-645f8d15f48f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.670230 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:25.683824 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] The token cache is being invalidate because project 04536fa2125b43a898797bc78f0acf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:18:25.684144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.684825 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b9cd42af-7e99-4ecd-8622-645f8d15f48f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:18:25.686637 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1450/2880] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:18:25 2022] DELETE /identity/v3/projects/04536fa2125b43a898797bc78f0acf40 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:18:35.302919 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:18:35.680531 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:15.061867 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:15.063653 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:15.122775 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690c77e-ac02-4df7-b3fd-aa247bc1d800 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:15.174385 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:15.175053 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:15.175334 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:15.175607 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:15.177581 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:15.238395 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:15.240427 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:15.249315 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1431/2881] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:19:20.895705 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:20.896277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:20.896277 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:20.914523 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] MFA Rules not processed for user `47642301725e4023aba48b2a3a64d5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:19:20.915720 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:20.923100 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1451/2882] 10.222.0.31 () {58 vars in 957 bytes} [Wed May 25 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:19:20.961692 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:20.963075 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:20.974270 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a2122-e5db-4d77-ac0a-bb5ce917477a service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:20.977894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005d227-7940-4363-8152-48654eff662a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca966a266e17460b8e38790f506eb406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:20.978533 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005d227-7940-4363-8152-48654eff662a service cinder] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:20.978818 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005d227-7940-4363-8152-48654eff662a service cinder] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:20.979098 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005d227-7940-4363-8152-48654eff662a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:20.981466 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3005d227-7940-4363-8152-48654eff662a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.050600 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=100 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:21.053184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005d227-7940-4363-8152-48654eff662a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:21.055033 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005d227-7940-4363-8152-48654eff662a service cinder] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:21.066957 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1432/2883] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:19:21.353452 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:21.355362 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.412804 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8c87f-d026-4269-afac-64ef60301b1d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:21.416364 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:21.417500 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:21.417788 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:21.418065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:21.419831 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.429340 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:21.430810 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:21.439614 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1452/2884] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:19:21.891084 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005d227-7940-4363-8152-48654eff662a service cinder] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:21.892613 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-3005d227-7940-4363-8152-48654eff662a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.900763 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:21.903128 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.913640 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961f159-8f4a-41f5-8cc0-c33a5536e691 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:21.918151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:21.918790 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:21.919076 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:21.919353 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:21.921151 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.934754 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:21.936189 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:21.947661 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1453/2885] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:19:21.965759 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005d227-7940-4363-8152-48654eff662a service cinder] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:21.970894 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:21.971620 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:21.971977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:21.972324 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:21.974236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:21.986687 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:21.988419 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:21.998710 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1433/2886] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:19:31.942540 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=35 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:31.994144 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=34 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:34.039575 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:34.051899 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31dcef-1cec-418c-880e-ed966293804d service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:34.057731 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:34.059674 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:34.060915 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:34.061553 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:34.064937 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:34.081471 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:34.083391 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14dcea-c027-4256-836b-71054509ee42 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:34.097048 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1454/2887] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:19:38.338636 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:38.340291 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:38.356958 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200d8e1-14b2-4aa5-9073-f31980e0e750 service placement] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:38.364571 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:38.365414 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:38.365845 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:38.366353 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:38.368565 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:38.385025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:38.386652 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:38.407731 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1434/2888] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:19:41.974130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:41.974573 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:41.974816 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:41.993904 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] MFA Rules not processed for user `5f8e29b225c249fbab929273e2f573d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 17:19:41.995196 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:42.056491 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1455/2889] 10.222.0.31 () {58 vars in 967 bytes} [Wed May 25 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 17:19:42.099674 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:42.101592 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:42.170656 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b202f-1dea-4565-a6aa-d37908ed9d51 service nova] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:42.175954 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d82cb54434427d816780c435562667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:42.176611 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:42.176926 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:42.177209 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:42.185643 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:42.187645 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:42.196177 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1435/2890] 10.222.0.31 () {60 vars in 1384 bytes} [Wed May 25 17:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 17:19:48.862876 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:48.865197 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:48.932159 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fe749-b273-4c09-8bbc-7501f4768f8f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:48.936775 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:48.938529 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:48.938796 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:48.939073 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] PATH_INFO: `/v3/users/03703b61e1d3442aaf8346abb5159725` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:48.940309 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03703b61e1d3442aaf8346abb5159725)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:48.942332 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:48.987495 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03703b61e1d3442aaf8346abb5159725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:48.994732 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03703b61e1d3442aaf8346abb5159725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:48.995358 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03703b61e1d3442aaf8346abb5159725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.008455 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03703b61e1d3442aaf8346abb5159725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.015699 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03703b61e1d3442aaf8346abb5159725'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.021949 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1456/2891] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:19:48 2022] DELETE /identity/v3/users/03703b61e1d3442aaf8346abb5159725 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:19:49.194149 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:49.205339 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03efd7b-3d4f-497d-809f-0bfd9b8a3ae8 service swift] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:49.265947 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:49.266821 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:49.267113 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:49.267391 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] PATH_INFO: `/v3/projects/195f7502e12548c5820b9b176a98b349` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:49.268609 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195f7502e12548c5820b9b176a98b349)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:49.270556 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:49.316904 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195f7502e12548c5820b9b176a98b349', 'request_id': 'req-4ff4be70-40bb-4f83-add9-4e95c087e062'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.324185 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195f7502e12548c5820b9b176a98b349', 'request_id': 'req-4ff4be70-40bb-4f83-add9-4e95c087e062'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.330520 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195f7502e12548c5820b9b176a98b349', 'request_id': 'req-4ff4be70-40bb-4f83-add9-4e95c087e062'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.340792 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] The token cache is being invalidate because project 195f7502e12548c5820b9b176a98b349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:19:49.341105 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.341744 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.343796 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1436/2892] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:19:49 2022] DELETE /identity/v3/projects/195f7502e12548c5820b9b176a98b349 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:19:49.347875 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:49.349315 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:49.363130 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134371e-6801-4cb7-8cd5-69c0ac7b11d2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:49.370690 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:49.422987 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:49.424065 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:49.424407 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:49.424772 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] PATH_INFO: `/v3/users/9312ea3c30f14170a89f881b5583dbcf` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:49.426182 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9312ea3c30f14170a89f881b5583dbcf)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:49.428396 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:49.474606 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9312ea3c30f14170a89f881b5583dbcf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.481800 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9312ea3c30f14170a89f881b5583dbcf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.482627 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9312ea3c30f14170a89f881b5583dbcf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.495031 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9312ea3c30f14170a89f881b5583dbcf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.501821 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9312ea3c30f14170a89f881b5583dbcf'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.507735 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1457/2893] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:19:49 2022] DELETE /identity/v3/users/9312ea3c30f14170a89f881b5583dbcf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:19:49.684438 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:19:49.685908 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:19:49.699281 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4be70-40bb-4f83-add9-4e95c087e062 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:19:49.703802 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:49.771824 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:19:49.772713 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:19:49.773003 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:19:49.773280 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] PATH_INFO: `/v3/projects/cbc1a307200d4bd8bf7a9b8f1367436f` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:19:49.774468 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc1a307200d4bd8bf7a9b8f1367436f)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:19:49.776394 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:19:49.823977 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc1a307200d4bd8bf7a9b8f1367436f', 'request_id': 'req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.831314 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc1a307200d4bd8bf7a9b8f1367436f', 'request_id': 'req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.837615 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc1a307200d4bd8bf7a9b8f1367436f', 'request_id': 'req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.847780 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] The token cache is being invalidate because project cbc1a307200d4bd8bf7a9b8f1367436f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:19:49.848091 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.848748 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:19:49.850276 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1437/2894] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:19:49 2022] DELETE /identity/v3/projects/cbc1a307200d4bd8bf7a9b8f1367436f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:19:59.504188 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:19:59.845236 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:12.959229 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:12.960657 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:13.114512 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13114047-1826-4b24-aaa2-c8ac318ab796 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:13.189047 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '600d472e73da4c96af486c16a3f7df81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:13.190022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:13.190022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:13.190579 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:13.192351 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:13.205785 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:13.207550 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:13.224173 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1458/2895] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:21:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 17:21:18.464383 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:18.465959 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:18.549910 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87a45-ff9f-49ec-ad7a-9d9b2827c380 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:18.553664 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722c501d471d402b9b7eb5879b103ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:18.554312 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:18.554596 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:18.554872 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:18.556631 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:18.641663 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:18.643118 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:18.662035 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1438/2896] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:21:21.993649 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:21.995203 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:22.039087 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:22.078917 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97c77c-0e15-4672-a50f-a616b997d378 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:22.084323 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:22.085635 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:22.085922 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:22.086325 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:22.088116 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:22.101421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:22.103022 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:22.114043 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1459/2897] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:21:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:21:24.957504 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:24.958969 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:24.972407 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e311-f578-49d8-bb89-a33849f52a38 service neutron] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:24.977399 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:24.978267 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:24.978543 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:24.978813 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] PATH_INFO: `/v3/users/47642301725e4023aba48b2a3a64d5b9` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:24.979988 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47642301725e4023aba48b2a3a64d5b9)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:24.981984 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:25.030193 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47642301725e4023aba48b2a3a64d5b9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.030859 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47642301725e4023aba48b2a3a64d5b9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.031463 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47642301725e4023aba48b2a3a64d5b9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.035831 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:25.045418 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47642301725e4023aba48b2a3a64d5b9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.052352 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47642301725e4023aba48b2a3a64d5b9'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.065184 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1439/2898] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:21:24 2022] DELETE /identity/v3/users/47642301725e4023aba48b2a3a64d5b9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:21:25.239205 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:25.251607 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba1f-ad85-4030-ba33-bc92440fc80d service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:25.308895 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:25.309753 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:25.310042 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:25.310320 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] PATH_INFO: `/v3/projects/df9bc8d103cf40e1b8d984f1947e7c5d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:25.311501 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9bc8d103cf40e1b8d984f1947e7c5d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:25.313463 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:25.360868 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'request_id': 'req-3c53136c-ef85-446f-a4ef-1d3b5567645a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.367055 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'request_id': 'req-3c53136c-ef85-446f-a4ef-1d3b5567645a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.373138 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9bc8d103cf40e1b8d984f1947e7c5d', 'request_id': 'req-3c53136c-ef85-446f-a4ef-1d3b5567645a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.384741 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] The token cache is being invalidate because project df9bc8d103cf40e1b8d984f1947e7c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:21:25.385026 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.385633 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.387158 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1460/2899] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:21:25 2022] DELETE /identity/v3/projects/df9bc8d103cf40e1b8d984f1947e7c5d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:21:25.391156 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:25.392587 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:25.406357 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8db68-be22-4f64-9fba-ef76b9c09aa9 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:25.462931 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:25.463717 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:25.464025 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:25.464299 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] PATH_INFO: `/v3/users/c9ccc8ef411b4f6782536bced8440fb5` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:25.465521 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ccc8ef411b4f6782536bced8440fb5)` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:25.467901 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:25.517249 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ccc8ef411b4f6782536bced8440fb5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.517941 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ccc8ef411b4f6782536bced8440fb5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.518545 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ccc8ef411b4f6782536bced8440fb5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.536512 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ccc8ef411b4f6782536bced8440fb5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.544879 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.notifications [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ccc8ef411b4f6782536bced8440fb5'} {{(pid=80163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.558834 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1440/2900] 10.222.0.31 () {58 vars in 1223 bytes} [Wed May 25 17:21:25 2022] DELETE /identity/v3/users/c9ccc8ef411b4f6782536bced8440fb5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:21:25.726944 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:21:25.728421 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:21:25.741478 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53136c-ef85-446f-a4ef-1d3b5567645a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:21:25.793945 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:25.801746 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4dc5eccddf4937ae7c342c241f1972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e51ce5f84b498ea59e7bf6bab45356', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:21:25.803041 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:21:25.803519 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:21:25.803841 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] PATH_INFO: `/v3/projects/63624ae00fdd4c0a9b94c7fc2887fdb9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:21:25.805144 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63624ae00fdd4c0a9b94c7fc2887fdb9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:21:25.807256 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:21:25.854590 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63624ae00fdd4c0a9b94c7fc2887fdb9', 'request_id': 'req-938f1585-7fc8-43ab-94c4-d948cd39ba7f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.859927 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63624ae00fdd4c0a9b94c7fc2887fdb9', 'request_id': 'req-938f1585-7fc8-43ab-94c4-d948cd39ba7f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.866089 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63624ae00fdd4c0a9b94c7fc2887fdb9', 'request_id': 'req-938f1585-7fc8-43ab-94c4-d948cd39ba7f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.878493 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] The token cache is being invalidate because project 63624ae00fdd4c0a9b94c7fc2887fdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 17:21:25.878786 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.879430 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-938f1585-7fc8-43ab-94c4-d948cd39ba7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 17:21:25.881006 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1461/2901] 10.222.0.31 () {58 vars in 1232 bytes} [Wed May 25 17:21:25 2022] DELETE /identity/v3/projects/63624ae00fdd4c0a9b94c7fc2887fdb9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 17:21:35.555433 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:DELETE=13,keystone:SELECT=63,keystone:INSERT=2 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:21:35.875438 dv-cinder-843309-1-iscsi devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 17:22:20.775294 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Authenticating user token {{(pid=80163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 17:22:20.776760 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:22:20.872030 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8d1fb-6b89-4ca5-a098-ac23af46da03 admin admin] Validating token access rules against request {{(pid=80163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 17:22:20.928386 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46555ca1a1404b94a39486d73a017f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081f5d965327435dba6971aab789335e', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 17:22:20.928987 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] REQUEST_METHOD: `GET` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 17:22:20.929269 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 17:22:20.930096 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 17:22:20.931865 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.fernet_utils [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 17:22:20.943183 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 17:22:20.944815 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cebe6-1ccc-470c-aa9b-62354be719d9 service placement] RBAC: Authorization granted {{(pid=80163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 17:22:20.955179 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: [pid: 80163|app: 0|req: 1441/2902] 10.222.0.31 () {60 vars in 1365 bytes} [Wed May 25 17:22:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 17:22:30.951103 dv-cinder-843309-1-iscsi devstack@keystone.service[80163]: DEBUG dbcounter [-] [80163] Writing DB stats keystone:SELECT=67 {{(pid=80163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}